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Foreword 



When a child's score from a standardized test is studied by the 
teacher, it often evokes such comments as, ''Charles does better 
than that in reading," or "I could have predicted that score for 
Sue," or "That score does not indicate the type of work Tom does/' 
These reactions are typical because the good teacher a keen 
observer. In fact, the trend in education recently is to place more 
weight on "teacher observation" than on formalized testing. This 
book is directed to the practitioners in the classroom, to aid them 
in the process of observing students reading and translating these 
observations into au evaluation of reading performance. The 
teacher in this role is a diagnostician with an intellectual approach 
for identifying reading strengths and weaknesses in order to aid 
the student 

"A conference titled "What Kids Do in Reading" at the University 
of Chicago in summer 1972 provided a forum for airing new ideas 
and insights into observing the reading process. The papers coU 
"iedted here emerged from the research that conference generated 
and present ideas that can be applied directly in the classroom.- 
Sponsored by the National Conference on Research in English 
(NCRE) and the ERIC Clearinghouse on Reading and Communica- 
tion Skills, this monograph is brought to teachers under the editor* 
ship of William D. Page* 

The ERIC system makes available— through the ERIC Document 
Reproduction Service— a wealth of information, including all 
federally funded research reports since 1956. If the findings of 
specific educational research are to be rendered intelligible to 
teachers and applicable to teaching, considerable bodies of data 
must be reevaluated, focused, translated, and molded into an 
essentially different context. Rather than resting at the point of 
making research reports readily accessible, the ERIC Clearing* 
houses commission recognized authorities to produce state-of^the* 
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art papers, bibliographies and monographs in specific areas* The 
present publication is designed to be a bridge between teachers 
and research in such topics as the cloze procedure, readability 
formulas, miscue analysis, reading strategies, informal reading 
inventories, and concepts and reading in the content areas* 

As the body of information derived from educational research 
has expanded, so^ has the gap between research and classroom 
teaching. But if teachers can apply the concepts presented in this 
monograph, the widening gap between research and the classroom 
will narrow and students will have an improved environment for 
developing their ability to read. 

Sister Rosemary Winkeljohann 
ERIC Clearinghouse on Reading and Communication Skillr 
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FOREWORD 



Introduction 



If Edmund Huey could read this book, he would find in it exten*^ 
sions of the thc^ories and methodologies he began to explore more 
than three-quarters of a century ago. He might find it strange that 
reading research and theory wandered for so many years in a 
largely nonproductive wilderness before they came back to some 
essential realities: 

Understanding reading must be built on understanding what 
happens when the reader is interacting with written language. 

Insights based on responses to bits and pieces of language 
(letters, sounds, words, sentence fragments, lists of unrelated 
sentences) do not illuminate how readers get meaning from 
written language or learn to do so. 

Readihg is a receptive language process. It must be studied 
using tools and insights appropriate to linguistic research. 

The reading process may be the same for everyone but each 
pupil learns to control it individually. Productive instructional 
decisions are best made by teachers who understand the process 
and know how to interpret pupils' use of that process at any 
given time. 

Physical and mental abnormalities in learners may influence, 
the acquisition of reading, but even abnormalities must be 
considered in a framework of how meaning is constructed from 
written language. 

Full appreciation of reading as the receptive phase of commu- 
nication between the writer and reader means awareness of 
the extent to which the specific conceptual background and 
interest of the reader influence comprehension. 
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Helen Robinson, whose paper serves as an historical bridge from 
Huey's early beginning to contemporary theory and research, 
quotes Huey's simple, direct challenge: "We have surely come to 
the place where we need to know just what the child normally 
does when he reads, in order to plan a natural and economic 
method of learning to read." He said that in 1910. 

Commitments to knowing "what the child normally does" as a 
means of planning "a natural and ecbnomic method of learning 
jUliread" are the threads that run through the papers in this volume. 
Robinson comments that research has focused more on the mate- 
rial to be read than on the reader. The authors in this volume, 
however, look at both the reader and the written language jn the 
context of the interaction between the two. 

The papers of Carolyn Burke and Yetta Goodman plunge us into 
the reading process as it may be seen through miscues, the un- 
expected responses readers produce. Burke asks, and answer^, the 
question, "How can we (tejachersj gain the information needed to 
offer reading instruction without disrupting the reading process?" 
Her answer is to learn to use the miscues children make withlh a 
framework of how reading works. She warns us not to be superficial 
or too quick to make snap judgments, "to assume that all of the 
words the reader has omitted are unknown" or that certain sub 
stituiions indicate phonics problems. 

— Burke illustrates the reading process with examples of actual 
reading miscues and at the same time demonstrates how to ob- 
serve and interpret miscues. For the teacher, Burke argues, miscue 
analysis is a way of "tapping the reading process as the reader 
uses it/' so that the teacher can "support the reader in discovering 
and developing those techniques and understandings" necessary 
to independent flexible reading. 

Goodman labels these "reading strategies.'' They are, she says, 
"natural to the reading process." "Reading strategies are the myriad 
ways readers process information when dealing with written lan- 
guage." The teacher's role, as Goodman describes it, is one of 
facilitating the development of these strategies. This is a sharp 
contrast to the traditional "skill" focus, in which teachers are 
viewed as the source of specific skills which they instill in their 
pupils. 

Picking up where Burke leaves off, Goodman describes a young 
reader using "the semantic and syntactic system as well as a 
graphophonic system" in dealing with "natural written language." 
The teacher "must discover which strategies the reader is using 
effectively and which strategies the reader needs help to develop." 
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Readirlg strategy lessons based on evidence from miscue analysis 
are the means Goodman advocates for this supportive help, for 
this material is natural, meaningful, and designed to focus the 
readers' use of appropriate strategies/Goodman emphasizes the 
crucial ''need for teachers knowledgeable about language, how 
language is learned, and what the reading process is like/' 

DeLawter explores patterns of miscues in children who have 
received different kinds of reading instruction. Her study shows 
that instructional focus in reading does affect the reading process 
and the types of miscues children produce, but that universal 
aspects of the process appear regardless of instruction. 

Carlson looks at the differences in miscues produced in reading 
different content materials. He finds that his research and similat: 
research show the reading process to be essentially the same across 
content materials. The focus, he feels, needs to be on building 
concepts appropriate to each area. Carlson suggests that miscue 
analysis be used to indicate the conceptual problems readers are 
having. 

Bomiuth draws on his work using the clo/e test to examine the 
readability of texts on the one hand and pupils' ability to com- 
prehend texts on the other. Readability formulas have dealt with 
quantifiable aspects of written language in order to assign a level 
of difficulty to any given text, but they have left out the learner. 
Comprehension te^ts, on the other hand, have been designed to 
assign a level of competence in reading comprehension to a reader 
which would then apply to anything he or she reads. 

Bormuth distills from his research and that of others what he 
hopes will help teachers find appropriate reading materials for 
specific pupils which they can comprehend and from which they 
can learn. In this latter sense, Bormuth moves beyond common 
definitions of comprehension to one that involves acquiring new 
knowledge through reading. 

Peggy Williams reports a study that exposes the misconceptions 
that can result from research which isolates linguistic elements. 
She finds that "evidence" linking "poor auditory discrimination" 
(as demonstrated on the Wepman test) with poor reading among 
black children is in fact largely a reflection of the inappropriate- 
ness of the test for the group. The performance reflects language 
difference, not auditory deficiency. Reading programs "resulting 
from inaccurate descriptions have consumed considerable time 
and money but failed to extensively improve the lot of the 'under- 
privileged' child," she warns. 

In the concluding paper. Page and Barr bring together the 
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strands of the rcMiewed interest in planning instiuction by observing 
the reader interacting With written language. They build around the 
informal reading inventory, a simple device that any teacher or 
reading specialist can use. The authors show how new insights, 
new devices, and new understandings of the reading process can 
make the informal reading inventory a tool that will provide an 
insightful practitioner the information needed to plan effective 
personal instruction. 

This book has many practical suggestions for instruction. All of 
them come from our return "to the place vvhere we need to know 
just what the child normally does when he reads." 

Kenneth S. Goodman 
Wayne State University 
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INTRODUCTION 



1 Ittilghts from Research 

Children's Behavior while Reading 



Helen M. Robinson 



Scattered reports of children's behavior while reading were made 
before the turn of this century. Besides, every good teacher has; 
records, either oh paper or in memory, of the reading characteris- 
— tics of some pupils. In 1910, Huey said "We have surely come to - 
the place where we need to know just what the child normally does 
when he reads, in order to plan a natural and economic method of 
learning to read" (p. 9). With such a long history of observations, 
why are we returning to this topic, as a modern issue? 

At least ffve reasons appear to the writer to be of major impor- 
tance. First, the best minds in the field of reading and in allied 
fields are challenged to throw light on the reading process If the 
process could be understood, it would be possible to identify 
ifactors that facilitate as well as interfere with reading, from the 
beginning through the mature stages. 

The best that we can do at present is to infer the process from 
the product* As a result, widely different interpretations can be 
made of the same sets of test scores, errors in oral reading, observa- 
tions of children v hile they read, e9& movement records, and other 
data. The point of view of the person who interprets these data 
often makes a marked difference in the conclusions reached. From 
such differences have come a host of models of reading or of the 
rijading process. As a part of the targeted research sponsored by 
the United States Office of Education, Davis (1971) prepared and 
edited a lengthy report. The report shows that some models of 
reading represent a proliferation of skills, while other models are 
so simple that they embrace only a minute segment of what is 
usually considered reading. 

A second reason for examining children's behavior while reading 
is that in a new era, children may be different than they were in 
earlier years. Travel and TV, for example, have created experiences 
and attitudes different from those of the rural child who was only 
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familiar with animals and family life. Furthermore, our attention 
has been focused on a group of children once overlooked --inner 
city children. The universality or diversity of reading behaviors 
may make more sense if a relatively good cross-section of the 
population is studied. 

A third reason to reexamine chiildren's behavior is that we have 
J3ei!y.>foci for research. Teachers oV researchers see essentially what 
they are looking for. What Gray (1916) called oral reading errors, 
Goodman (1968) calls miscues. The difference is not one of ter- 
minology alone. Whereas Gray looked for mechanical problems, 
such as faulty vowels and consonants, reversals, addition and 
omission of sounds, and the like, Goodman focuses on successful 
or unsuccessful use of the cues. In particular, he is concerned with 
how the miscue approximates the text in terms of syntactic (ar- 
rangement of words in grammatical units), semantic (meaning), 
and symbol-sound variations. Taylor (1937) trained children and 
adults to eliminate regressive movements of the eyes mechan- 
ically; recent investigators explain that even the good reader must 
regress to examine the text if meaning is interrupted. Early studies 
found word-by-word reading to be characteristic of immature 
readers and urged that children be taught fluency from the begin- 
ning. Clay (1966) found that pointing to words is a necessary stage 
in learning to match printed to spoken words. The foregoing 
examples make it clear that recent orientations give new informa- 
tion because of what we see and hear as we study children. 

A fourth reason to reexamine children's reading behavior is to 
quantify the datn obtained from such observations. This is not to 
say that we must return to the complicated statistical procedures 
that often yielded little because the input was limited. Instead, 
case study data can be quantified to reveal characteristic behaviors 
at various stages of reading growth. Then atypical behavior pat- 
terns can be examined in relation to stages of growth and individ- 
uals with acute needs can be identified. 

A fifth reason for studying children's behavior is to generate 
hypotheses for other types of investigations. An example is Clay's 
(1966) discovery thai many beginners do not know the boundaries 
of printed words. Following her report came experimental research 
by a half-do2:en persons who confirmed her findings and extended 
them to spoken words, letters, and sounds.. 

Historical Perspective 

An historical examination of reading behavior would be incom- 
plete without mention of Huey's famous report (1910) of the early 
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research and his intrrpiotation of it. His data were based largely on 
retrospective reports of sophisticated readers and crude eye- 
movement measures. For teaching, the consequences of this early 
report were many. A strong impetus was given to the teaching of 
words prior to letters by conclusions such as/'reading was in larger 
wholes than letters" (p. 73). Huey forecast the instructional pro- 
gram developed later and used predominantly until recent years: 
word form is composed primarily of the consonants since they 
protrude al .ove and below the lines (p. 81); meaning dominates the 
perception of words and phrases (p. 11b); stumbling and hesitation 
in oral reading comes from too much attention to the mechanics of 
reading, especially phonics (p. 302); "We know that the reading of 
life is almost exclusively silent reading. Yet in preparing for life, 
we are instructed almost exclusively in reading aloud . . (p. 10). 

Furthermore, Huey wrote at length about the "natural" way of 
learning to \eadat home. Huey felt that, just as children's curiosity 
is satisfied by answering their questions, children would accu- 
mulate and learn better a large stock of sight words if their curiosity 
about print were satisfied. In an eminently modern suggestion, he 
stated that, "The secret of it all lies in parents' reading aloud to 
and with the child." 

In summary, many of the materials and methods for teaching 
reading today were suggested in these early years and, as Huey 
said, the reason we continue to do many things is because that is 
what has always been done (p. 11). In this monograph, we are 
looking for better reasons for what is being done. 

To study the reading process, two essential ingredients must be 
examined: the reader and the selection read. If the significant 
characteristics of each could be identified, then the interaction of 
the reader and the material could be interpreted. Far more research 
has been done on the materials than on the reader, although many 
inferences have been made from the materials and attributed to 
the reader. To determine the accuracy of the inferences, a great 
deal more must be learned about the reader. 

Materials have been studied extensively because they are static 
and tangible. They lend themselves to word counts, syntactic 
analyses, and myriad alterations. In contrast, the readers change 
constantly, have been influenced by several years of home and 
neighborhood conditions, possess varving amounts and types of 
language facility, and differ in their interests in and motivations 
for reading. For this reason it has not been possible to isolate all 
of the individual factors bearing on reading behavior nor to assess 
the influence of combinations of factors on the interaction of the 
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BEST COPT AVAILABLE 

rtMilcM with the riKiliM iais. I lu^i' j^oiils must cu hievecl in order to 
obtain accurate knowledge ot the reading process. 

Approac:lu»s to I)i»sc'ribiny Reading* Behavior 

hitrosf)ection and relrosptn lion were used widely in reading 
studies lietore the turn ol the century. IhereatrtT, most of the 
procedures now liein^* ust*d were [larlially descril)ed or forecast, 
especially l)y Huey (1910). Some techniques attracted more atten- 
tion and were more fully developed at an earlier date than others. 

Tostina proivduivs. Parallelling the study of eye-movements was 
the develofiment and extensive use of tests. Reading tests gave 
vivid evidence of the wide ranges of reading achievement in most 
classrooms. From the first standardised tests before 1920, chil- 
dren's behavior in silent reading has been assessed by the answers 
they gave to questions about what was read, hi the early years, 
teachers scored the tests and theoretically had the opportunity to 
see what kinds of errors were made. Increasingly, tests have been 
scored mechanically, with anrAver sheets and finally by machine. 
As test scoring became more mechanical, information about chil- 
dren's bi'havior decreased until nothing was known except an 
overall score or scores on parts of the test. This right-wrong scoring 
of answers became prevalent in classrooms as a means for teaching 
comprehension in silent reading. Tew teachers took the time to ask 
children how they arrived at answers, much less to lead them 
through the steps in arriving at correct answers. Thus the teaching 
of comprehension became, in essence, an exercise in testing. 
Children who were unable to learn, largely by trial-and-error, to 
answer questions correctly, continued to practice their errors until 
they attained a proficiency in making errors that led to failure. 

The Cray Standardized Oral Reading Paragraphs (1916) provided 
ample opportunity for examiners to hear and observe children's 
behavior while they read. However, the recording system forced 
attention to particular errors which were analyzed mechanically. 
Errors were largely explained as inaccurate perception and the 
remedy was drill, often with the words in isolation. 

The testing movement had a number of consequences for teach- 
ers. First, silent reading tests diverted teachers' attention away 
from pupils' behavior toward overall scores. Since there was little 
helpful information in the scores, analyses of difficulties and 
strengths were left largely to teachers' observations. Moreover, 
few teachers were trained to make optimal use of their observa- 
tions in order to help children solve their learning problems. 
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Second, the tt^stiriKol Im^v numl)(»rs of pupils revealed the wide 
ranges of reading achievement at any single i»rade level. Emphasis 
was placed on getting those below the norm up to it. The challenge 
of reading disability and retardation increased through the decades. 

Third most of the research in reading was based on performance 
on standardized reading tests. As scores of large numbers of pupils 
were analyzed statistically, the individual was lost in the group. 
Furthermore, nonr»tatistical research was considered less than sci- 
entific and, as a resuil, insights acquired from close observation 
of behavior were lost. 

About 20 years ago, the cloze procedure, a type of completion 
test, was devised tc measure readability (W. Taylor 195.3). A num- 
ber of investigators have shown that the clo/e is an adequate test 
of comprehension (Bormuth 1969a). However, scores on the cloze 
have been validated against conventional tests and experimenter- 
made test questions of which Bormuth (1969b) has been exceed- 
ingly critir.cil. 

The ck/ze procedure has also been used for instruction in 
comprehension with persons from first grade to college. The results 
of usmg the test alone have not been promising except in two 
studies where instruction accompanied filling in the cloze blanks. 
Jongsma (1971) has suggested that instruction aimed at improving 
vocabulary or the use of context clues, if conducted over a suffi- 
ciently long time, might be useful at particular grade levels. 

Like standardized reading tests, the cloze tests manipulate text 
but give little insight into the reader unless other techniques are 
added. However, they have the advantage of allowing the study of 
various linguistic classes of words, and as used by Jenkinson (1957) 
with introspective and retrospective techniques, permit many in- 
ferences about printed language. 

Eye-movement photography. The invention of motion picture film 
before 1920 permitted extensive studies of the behavior of a per- 
sons eyes while reading varieties of texts. A host of research 
followed, comparing oral with silent reading, using differetit types 
of materials read for different purposes, and comparing eye-voice 
span. Buswell (1922) and his associates, for example, demonstrated 
a characteristic pattern of increase in span and length of fixations 
accompanied by a decrease in regressive movements from first 
grade to adulthood, with the most marked changex)ccurring during 
the first four grades. Large individual differences were found to be 
related to performance on standardized tests. 

Some very significant implications for teaching reading came 
from the eye-movement studies. First, there came an emphasis on 
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(levol()f)inn t ()n)|n»trru in silent readinfi rather than just in oral 
reading. Today silent reading i^ usually taught as early as the first 
year in school. 

A second consequence was the impetus to use a wide variety of 
materials to teach reading. Since eye movements differed when 
children read in different contexts and subject areas, it was rea- 
soned that children should learn how to read in science, social 
studies, and all curriculum areas. 

A third consequence has been an emphasis on rate of reading, 
both for adults and children. At one time, some persons were 
convinced that reading rate could be improved by improving the 
mechanics of eye movements; that is, increasing the span with 
short exposures and decreasing the regressive movements by 
covering rr.aterials as they were read. Many investigators seemed to 
agree that motivation for rapid reading was the common element 
in all rate techniques. Furthermore, most studies supported Bus- 
well's original conclusion that eye movement characteristics are 
symptoms rather than causes of slow reading rate. 

A fourth consequence of the eye-movement studies has been a 
number of admonitions to teachers— i.e., discourage repetition, 
urge rapid reading, and eliminate pointing to words or you may 
reduce fixations and spans. Later in this paper we shall see that 
other interpretations suggest that these admonitions may 
be incorrect. 

Today, eye-movement photography has been revived. Newer 
techniques such as the electromyograph permit much greater 
freedom of movement of the eyes. Furthermore, the computer can 
be used to report various characteristics of eye-movement behav- 
ior. These modern findings will be interpreted differently depending 
upon the orientation of those doing the research. Those concerned 
with information processing suggest that the mature reader uses 
fewer cues than the immature reader and, therefore, successive eye 
fixations may be determined by how closely the language of the 
text fits that anticipated by the reader. Additionally, even regres- 
sions have been found useful when they provide the reader with 
more cues to meaning (Goodman and Burke 1968). 

/nfro.specf/ve-refrospecf/Ve reports. In the last century introspective- 
retrospective reports were used by sophisticated subjects. How- 
ever, the verbalization of unsophisticated subjects interpreted by 
psychologists is of relatively recent origin (Duncker 1945). 
Piaget's (1952) interpretation of introspective-retrospective reports 
by children is probably the best example. Swain (1953) applied 
this technique to college students' answering questions; Piekarz 
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(1*)S4) searched lor most productive anions thirteen ways ot 
presenting materials. Subseciuently, intros^jective-retrospective 
reports were used with subjects from third urade to college. The 
studies contrasted responses ot Kood versus poor readers in a 
variety of situations: prose and f)0(»trv int(»rpri»tations; r(»adinK for 
different purposes; and reading in different content areas. Highly 
creative students were compared with those having hi^h I.Q.'s; 
students' involvement in reading was also explored. 

The ran^e ot topics investigated was wider than could lie ex- 
()lored by the techniques previously discussed. Furthermore, in 
most instances the learner was the focus of study rather than the 
materials. 

However, three major difficulties are inherent in this technique. 
First, it is questionable whether subf^ects really verbalize all of 
their thoughts. Second, as Simons (1971) points out, inental proc- 
esses that occur rat^idly may not even be available to the subject 
for verbalization. Third, the mass of verbal materials must be 
analyzed so that the investigator obtains information from it. 
Therefore, schemes for classifying protocols may vary widely 
depending upon the orientation of the investigator. 

Perhaps the most important implication of this type of study, 
for teachers, is the recurrent suggestion to ask students why or how 
they arrived at given interpretations. Students' reactions to what 
they read mav be emotional or intellectual; that is, students may 
adopt strong positive or negative attitudes toward the materials 
and refuse to get the author's ideas, or they may misinterpret the 
author's ideas because they fail to follow the logic of an argument. 
Whatever the problem, teachers who ask students to verbalize 
reasons for tlieir responses to selections find the experience 
rewarding. 

5vsfen)at/c observat/ons and descriptions. In the last decade, 
researchers have returned to observing and describing children's 
behavior while reading. These recent reports emphasize systematic 
observations rather than random or casual ones. The number of 
subjects observed has increased as has the period of time over 
which observations are recorded. 

Notable among the investigators have been MacKinnon (1960), 
Clay (1966), Goodman and Burke (1968), and Soderberg (1971), All 
except Clay's work have been published, s(> it will be summarized 
bri(»fly. She selected 100 children entering five schools in New 
Zealand with a mean age of 5 years, 1 week. Once every week of 
the academic school year each child read, to the investigator, the 
pages of reading materials for which the classroom teacher had 
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f)ri»f)tiriHl hiin in Ikm ddv us(»(l a c hock sIhhH (l(>rivi»(l trom a [)il()t 
studv till* f)ri»c t»clinj; yi ar. In addition, shi? madr apf)r()f)riato nota- 
tions, i?spi»ciallv during? thr prt-riMdiny pi>riod. Children's com- 
mi»nts won* noti»d. Grnrrally, the "most strategic ohservatijns" 
\vi»ri» ordi»ri>d to hv sure thai comrnon data wvw c(^lli>ctiMl. For 
i»\ampU», first f)rii)ritv was yiviMi to all oral rrsponsi»s tourittiMi U^xt. 
then to m()tor responses, rate of reading, and any indications 
of fi^t^lir^s. 

In addition to obsi»rvations, tests wen? ^ivi^n at mean a^es of 
^ years, f> years b months, and b years. The earliest tests were of 
lan^ua^i*, auditory memory, and perceptual correlates. The Metro- 
politan Reading Readiness Test was ^iven at all three a^es. The 
criterion test was a combination of a word perception test devised 
bv Clay and the Schoni^ll Ri. Finally, the book bein^ read and the 
child's accuracy li»vel on this book were consiclered. Based upon 
achievi»mi»nt at the end of the first year, the pupils were divided 
into (luartiles so the accumulated data could be studied in relation 
to achiev(»nu»nt. 

All of the children had a period of reading readiness and then 
were jjivcMi books with instruction stressing fluency, meaning, and 
"li»arnifi« as one reads" with slight attention to letter-sound asso- 
ciations or a basic si^ht vocabulary. At first, children drew pictures, 
created captions, and read them. When they performed this task 
well tlu»y wen* promoted to reading readiness books, then on to 
preprimers. 

Clay (observed that behavior durinj^ the preparation period ap- 
peared to fall into three maior categories. Toward the end of the 
preparation period, the three cati*Kories seemed to be combined 
into matching behavior. The first category, visual sensitivity to 
letter and word forms, was demonstrated largely by children's 
scribbling, which seemed to show awareni?ss of what prmt repre- 
sented. The developmental sequence for li»tters, words, and word 
groups was scribble, invention, realistic co()y plus invented varia- 
tions, errors within almost correct patterns, and, finally, correct 
forms. Anions the 100 children studied, some could already print 
their names whim they entered school but others required an entire 
year to do so. 

Direr tional orientation was the second car.e>4ory: to observe this, 
Clav asked children to point with their fin^^ers while they read. 
They used their left hands more often than their ri^ht hands, which 
Clay f(»lt was due to the fact that in the books used print was on the 
left-hand pa^es and fiictures were on the ri^ht. The children's early 
behavior showed left-to ri^^ht, ri«ht-to-left, top-to-bottom, and 



1h 



hottonvto-top ntovfittJ'rtls iis vv(»ll as snaking movtMnents over the 
lines. One child proceeded right-tt)-lett on left pages and lett-to- 
right on right pages. In general the upper half of the group acquired 
consistent directional movements in 7 to 12 weeks; the lower 
achievers required ahout half a v^Mr and :hree pupils had not yet 
acquired this behavior by age h. 

. The third category, speech behavior, ( >ncerned what was said 
about picture captions. The steps observed were naming, a repet- 
itive short sentence (Here is a ), a >:atement appropriate to 

the picture but not the exact text, memorized text, and finally a 
vvord-by~word response which might be inaccurate. 

Integration of the three foregoing categories into mfttftrmg 
behavior occurred before children were judged by their teachers to 
be ready for their first book. Looking at print, children made speech 
responses, then checked whether the print matched. The following 
techniques were used: page matching, line matching, word and 
letter concepts, locating specific words when the text was known, 
reading* the spaces or voice pointing (staccato response), correc- 
tion due to mismatching the number of words, beginnings of word 
control (those the child had learned), and self-correction when 
visual-vocal mismatches occurred. Self-correction was manifested 
by 90 percent of the children- within 3 weeks of their promotion to 
books. 

Of special interest was the sequence of behaviors related to 
fluency. At first, children reading captions were as fluent as in 
their oral speech, with no awareness of errors. As they began 
matching behavior with fingers pointing to printed words that 
matched the text, each word was emphasized, in a staccato fashion. 
Transition from finger pointing to voice pointing led to lighter 
stress of the breaks between words and finally to phrasing. 

At the book-reading stage, a number of significant findings were 
noted. Among them: the average pupil in the high group read 
about 20,000 words per year in contrast to 5,000 words for the 
average pupil in the low group; pupils in the high group averaged 
1 error in 37 words contrasted with 1 in 3 for the low group; the 
high group corrected 1 in 3 errors while the low group corrected 
lin 20 errors. 

Clay's Conventions of Written English Test, given at age 5.0, was 
the best predictor of reading achievement at age fa.O (r= .79). This 
test includes 20 items and should be most useful to teachers, with 
its predictive value overshadowed by the diagnostic value. 

The findings of this extensive observational study are important 
in themselves, not to mention that hypotheses could be generated 
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Irorn the study loi ,i lilctinu* ot (•x[)i'rinKMitiil rrsedrc h, A tew ot the 
implications ot the study lor tOcU hers t\w worth ni(MitioninH. First, 
children need to learn the direction ot En^jlish print. Too often 
teachers take this characteristic for granted. When one-fourth of an 
(Aperinunital ^roup has not learned to follow print, left-to-risht, 
to return to the beyinrnny of the next line, and to move from one 
paye to the next in order, after six months, it is a significant source 
ot reading; difficulty. It is equally obvious that teachers can stress 
this convention of Enyl'sh in many ways. 

Second, it is important to determine whether childrt^n know 
what is meant whtm the teacher talks about a word c' a letter. 
Since only 47 percent of the pu[)ils in Clay's study could isolate 
"any word" (not [uonounce it) and 48 percent "a/r/ letter" at the 
end of one ytMr in s( hool, it is obvious that disc ussions of letters 
and w(jrds confused at least half of these children. Several studies 
clont* since (Downing 1970; Meltzer and Herse 1%9) have con- 
tirMKKl this finding for British and American children. Direct in- 
struction should be siven eady and consistently until children 
attain the concept of a word and a letter. 

Third, finder pointing to words and a staccato pronunciation 
may bv an important sia^t* in matching; printed words to spoken 
words. Children in the early sta^jes of learning to read may need 
this crutch. For years we have discouraged, or not even permitted, 
pointing to words, thereby depriving children of the prop they 
needed to move to the next stage. It seems likely that pupils will 
stop using their fingers and discoiuinue staccato pronunciation as 
they acquire competence in reading. If they do not, then teachers 
can discourage a habit no longer needed. 

Closely related is the mistaken expectation of fluency in reading 
from the very beginning. Since fluency may result from memoriza- 
tion and ditninish to "word calling" during the early matching 
stage, it should not l)e expected. If flutmcy does not reappear at a 
later stage, it can be encouraged without fear of halting pupils' 
progress. 

A fourth implication applies to all of the early reading behavior 
of children. Clay says of the pupil: "He must be given time to 
respond and must not be harassed because he searches at length, 
or because he fails to r(»s()ond" (1967, p. 26). Too often the rush of 
"covering ground" causes teachers to tell children the words, or to 
|)ermit able readers to make most of the responses. This practice 
may cause less mature readers to give up their search tor clues and 
become dependent on their teachers. Furthermore, these children 
lose the opportunity to practice new approaches which they can 
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use Kit(»r. An (msv \)iH V should ai i oinpanioci l)v help and 
guidance as ru»edi»d Id avoid unsui ('(vsstui l)i»havior or continuous 
prac tice ot errors. 

Finally, Clay suKK(»sts that a nunil)er ot the so-called reaclinf> 
rcMclincvss attril)utc»s may he ac (luircnl aloiiK with lc»arninK to read. 
In sonie sc hoi)ls. thc» Iowcm hall ol lht» ( lass nia\ bv^'in to rt>acl late 
in the* sc hool ycvu and l)c»c ause ol tluMr slow(»r responscvs, yet very 
little prac tice in reading. It schuiis ironic* that the c hildren who nec?d 
the most prac tice in rc>adinK rc>ally yet the least. 
* The t()reHoin}.» study and otht^r c)bsc>rvational investigations 
record l)ehavior which is sul)jc»ct to different interpretations. Clay 
showed how her data fit the thc?c)rc>tical frameworks of cognitive 
f)sychol()Hists and [)sych()loHists who havc> written about percep- 
tion as well as tit information processing models and linguistic 
models. The data on behavior partially fit different theories, and it 
is ol)vious that rc>searchers with different orientations could easily 
arrive* at divc»rH(*nt conclusions from the same data. Inferences 
about the rc»adinH [)rocess will thus differ accordingly. 

Ti\ichin^ rvtiirchcl nwclvrs. The b(>havior of retarded readers has 
l)een observt^d and recorded in de*'ail for many years. Reading 
clinics, such as at the University of Chicago, where daily diary 
records are kept, offer unlimited opportunity to examine reading 
behavior. The major problem in interpreting the behaviors is the 
assumption that something fundamental is wrong with the learner. 
In some instances, this assumption may be accurate. However, it is 
possible instead that learning was delayed at different stages of 
development by inappropriate instruction, prolonged school ab- 
sence, or personal problems that distracted the child's attention 
from reading. 

Numerous retarded readers have succeeded in learning to read, 
a success which points out the importance of motivation. The 
young person or adult who seeks help is usually highly motivated 
when he or she begins instruction. Others need motivation, both 
from the teacher and from having access to relevant and readable 
materials. 

Major research (efforts have focused on tlie learner and involved 
teams of specialists (Robinson 1946 and others afterward). In 
addition, diary records give attention to materials. The importance 
of such observations will be great once (»nough data are secured 
on pu[)ils who make progress, for only such data will allow an 
understanding of the stage at which the learning of retarded 
readers is halted. 
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SuninuKv 

Reading pursonnol are enjiaged in an inttMisive search tor infor- 
mation on the reading process. Each technique discussed has been 
assessed in terms of information elicited by the technique about 
the learner and the materials. It the techniques were placed on a 
continuum, standardized tests and the cloze procedure fall at the 
materials end. tye-movement photofjraphv ranks close to tests but 
offers some insight into personal behavior. Remedial reading 
instruction places closer toward the end labelled "learner." Obser- 
vations of behavior such as Clay's describe the materials but 
emphasize the learner. All techniques require interpretation of the 
data, interpretations that are largely dependent on the theoretical 
biases of the person making the interpretations. 

Each research technique has strengths and weaknesses. The best 
approximation to understanding the reading process should come 
from combining techniques whose strengths compensate for each 
others' weaknesses. No doubt reading research is still in the early 
stages Of scientific development. As Simons (1971) wisely says, 
facts are being gathered but the time has not yet come when 
relevant facts can be separated from the irrelevant. 

Research might profitably use groups of children with different 
backgrounds, languages, and cultural motivations to learn to read. 
Planned by a research team representing various theoretical orien- 
tations, observations of pre-reading behavior and longitudinal 
observations of children as they learn to read, using different 
approaches and different types of teachers, should provide a data 
bank for fruitful interpretation. Those who have analyzed materials 
for reading might supply the "best" available. Teachers would need 
to be trained to use these materials with the cloze procedure, with 
Bormuth's "Wivquestions" (1969b), with the best conventional 
questions that could be posed. Answers should be accompanied 
by introspection and retrospection concerning ways of arriving at 
answers or filling in clo/e blanks. Opportunities for both silent and 
oral reading should i^^ provided, so that miscues from the latter 
could be determiiv t!. Exploring pupils' concepts of what reading 
is and does (Estes 1971) and examining the internal motivation to 
correct miscues (Cohn 1972) could be useful. Pupils who expe- 
rience unusual difficulty could be studied individually and careful 
records made of their learning behavior. Eye-movement records of 
samples of pupils could complete the data. The data collected 
could be submitted to experts with different orientations. From the 
common core of inferences supplemented by unique interpreta- 
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lions niiglit (omc m piodiu tivt* model aroiiiul which tuluro re- 
stvirch coiild bv orniUii/iHl 

Meanwhile, teachers in the schools will continue to use the 
most relevant insights into childn^n and the best materials they 
can find to produce literate youth who can read and who want 
to us(» readiiin- 
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2 The Reading Process 

Oral Reading Analysis: 

A View of the Reading Process 



Reading} as an Independent txperience 

Reading is neither a team sport nor a spectator sport. The action 
occurs solely, and usually silently, between the author and the 
reader. In an attenit)t to interpret the author's niessajje the reader 
niak(»s use of his or her lanjjuaye, thoujjht, and fund of knowledge 
to reflect on the language structure and thought of the author. 
As reading ti»cu:hers, we can't sit figuratively on the sidelines to 
eitht»r call or analyse all of the "plays." Unlike football or basel)alL 
each "pltiy" or strat(»gy applied by the reader is not strung out 
across a field for our immediate observation. There are no called 
"time outs" when "play" halts while the reader goes into a huddle 
and maps out strategy. 

Because reading is. in many ways, a very private, personal, and 
independent experience it presents us, as teachers, with a very 
unique problem. How can we supervise reading without interfering 
with it^ How can we gain the information needed to offer reading 
instruction without disrupting the reading process^ 

The Teacher as Participator 

Our past attempts at offering reading instruction have focused 
on our participation as an active third party. Unfortunately, an 
interrupti(^n, no matter how momentary, disrupts the reading 
process. If we "give" the reader a word, we have failed to give him 
or her any way of handling, unaided, the next unknown item. If 
we stop the process and lead the reader through word attack 
strategies, we have so disrupted the reading that he or she is unable 
to employ the most useful of those strategies, context cueing. If 
we ask the student to re-read a section of text to hunt out a concept 
which he or she has failed to grasp or has interpreted in an un- 
expected manner, we tend to support the notion that there is one 
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rinlu answtM vvhi( h must hi* tUid can bv dorivtui from the proross. 

Our \vr\ \nvsv\Ki\ tis tin: third party, tiMuls to make the ncH>- 
pliyte reader DsycholoKically dependent upon outside support. 
It leads both the student and the teacher to conclude that the 
student does tiot have the ri»sources to handU* reading problems 
and thiit any unsolved f)rol)lems will lead to thi* total lireakdown of 
the ri»adinH r)rocess. 

As leading instructors, what vv(» have found nu)st perplexing is 
that the calculations and observations made by the reader are 
silent and unobservable. tven when we eavesdrop by having the 
student read orally, we are frustrated biaause we are observing 
only the performance of the whole process and not the process 
itsi'li. 

Or*il reading is fleeting. The sounds flow continuously by our 
ear and are almost immediately beyond our recall. As a third party 
f)articipator we are constantly forced to make snap judgements on 
the basis of segmented and limited surface level behavior. We find 
oursi>lv«»s organizinj} and i.roupinj; phenomena on the basis of 
least resistance.' We group and treat reading variations on gross and 
highly visible surface r-imilarities. We begin to assum j that all of 
the words th(* reailer has omitted are unknown to him or her; that 
reading substitutions which have minimal sound or graphic similar- 
ity to the text item indicate that the reader does not effectively 
use phonic cues; that the presence of uncorrected items indicates 
a loss of meaning; that the reader should be consciously aware, 
as we are, of all his or her variations from the text. 

Tappirg the Reading Process 

Instead of attempting either to participate in or to monitor the 
reading ot our students we need to find a way of tapping their 
reading. We need a procedure which will allow our students to 
read uninterrupted and totally independently so that we may 
evaluate their use of strategies, their flexibility, and their effec- 
tiveness as readers. We need a procedure which will allow us to 
retrieve and examine the process, not the performance, and which 
will allow us the leisure for an in-depth examination of that process. 

We need, in reading, a procedure which will match in usefulness 
the system of extended notation in mathematics. When our con- 
cern in a math class is not whether th(? student has arrived at the 
expected answer but whether he or she has proceeded through the 
necessary logical relationships, we ask the student to write out all 
of the calculations in solving a problem. The student can go 
through the process unaided and uninterrupted. At any later time 
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we can oxamino < .ik iiLiiions, determine what mathematical 
fjrocesses were ust^L note* how the student related them to each 
other, and decide whether further instruction mi^ht be needed. 

We need to find a way not to be team members or spectators 
but to be a part of the coachinj? staff, knowiny that coaches are 
restricted from the playinH field. 

In reading there are no extended notations which remain as cues 
to the processing that has occurred. There? are, however, oral 
reading variations which can be used for this purpose. 

All readers have instances in v.'nich they p^-oduce unexpected 
responses, instances in which they vary from the printed text. 
These miscalculations are reached via the same reading process 
and the same strategies and language svstems as the expected 
responses the reader produces. These miscalculations or miscues 
can serve the same function in reading that extended notation 
serves in math. Examining a miscue allows us to pinpoint the 
possible involvement of any and all of the related language sys- 
tems. We can tally not only their occurrences but their inter- 
relationships. Miscues which have a surface level similarity might 
or might not prove to have similar underlying causes. Miscues 
which are dissimilar on the surface can prove to have similar 
underlying causes. Analysis of reading miscues allows us to tap 
the reading process without interfering with it. 

The process for collecting reading miscues is very simple. The 
reader needs to be provided with a text vJiich is unfamiliar and 
relatively difficult for him or her to read. The reading should be 
tape recorded and uninterrupted and the students should retell 
the story onto the tape immediately following the reading. At 
least three perspectives are open to us through such fuji,scue anal- 
ysis: the reader's active role in the reading process, the effect of * 
the material upon the reader, and a view of reading 
developmental process. 

The Reader's Role 

Readers have a very active and productive role in the reading 
process. The extent and nature of their activity is highlighted 
in their miscues. 

In examples 1-6 the readers have produced a structural organiza- 
tion for the text sentence that differs from what the author 
produced. In some instances the reader was highly successful at 
changing the structure and was able to come up with a completely 
acceptable alternative: PoHtiV trotti^d off to search for scraps and 
bones and May we take pictures to send them to the contests 
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BEST COPY AVAILABLE 



In ono iiistcinii* k\ fiicimmcUically iUcoptabk' structuri? was pro- 
duced which had a ciupsti()nal)le or hijihly unusual mraninH: One 
day Suv was talking tn a .licturv in thv fiardvn. In still other in- 
stances the reader was unal)le to successfully complete the struc- 
ture and was left with just the In^HinninK portions of possible 
English sentences: 77iey . . . and It had i)vvn a lon^ day tor the 
(/o/{s and f/ie .... 

I . t Wh.i t arc thi'V^'"' asked Sue . . . 

— -k, 

J. 'Wtiv \\r t.iki» pit tiires tiiul send thcfU to thi» lontestr* 
V Due Sill' \v.)s t.)kinn .1 pictliri' in tlu' n<'itli'n. 

Hie 



4. Ihe shiillnw \\\su\ nj^Stilt C'riH»k Wiish hi»i *ime a 



*). It h.id hri'M a Uu)^ il.is tor thi' do^s iinij| l'i'j»j»v llinpi'd IummK 
lis slu' ii[)pro,u lu'd tlir i iiinp. 

Vv\\\\\ t rot t rd ott lo siMn UfUv i iinijltor si raps or honi»s. . 

lust a quick look at these examples makes one aware that a 
number of factors mi}4ht be involved in the readers' miscues: the 
occurrence of thvy in the near visual periphery in the first example; 
the close graphic and sound relationship between takit)n and 
talkinn in the third example; the compound noun structure of 
the do^s and Pvnny in the fifth example. The complexity of factors 
serves to ^ive each of the miscues a different surface flavor and 
helps to account for the varying decrees of success the readers had. 
But underlying all of these variations is the basic fact that the 
readers were actively /inticipating and producing structures as 
they read. They were not passively taking in the author's pre- 
structured material. 

In much the same way as they anticipate structure, readers 
can be seen to anticipate meaning. 

In example 7 the reader anticipates a common phrase, things 
tn f/o, and then on the basis of the new coat and the graphic 
similarity betw(}en hnrso and housv expects runs for our housv 
in place of fwd tor our horsv. Living in an urban setting prolxibly 
also contributed to this miscue. 

Th(» reader can be so sure of the story or plot line that he or she 
knows the intent of what is coming next and can produce such 
physically gross changes as "Ve.s, you may no atid have fun" 
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(t»\tiniplt» H) \vitlu)Ut ( IhmKiMK nuMnioK <it <ill. Much the same 
siturition exists in example 9, with the iKkk)i\ (element that the 
reader anticipated the repetition ot structure from the prior sen- 
tence. Structure rt^petition is a Mkely possibihty, as any connoisseur 
ot primt»r(»si» is well tiw<ire. 

Lxample 10 comes from a story about a sick /oo elephant who 
refuses to take her medicine. One of the readers reacts to the fact 
that powders can gener<illy be said to be sprinklvd into something 
but only liquids can hv sp/Z/ec/. The second reader, concentrating 
on the stealth ot the doctor, slipped the powder into the water. 

7. I wish wc I ould till 140. 

do 

lUil \\r liiuc in<un tilings id l)u\. 
\Vi» hiivc to Kct a new i()<!t lor \(»u. 

\Vc havf (() l>u\ teed tni our Imrsiv 



M. 'Ni's. vniifcln n()t| vi^/Tt) stay liome, . 
*). AWiW \hv\ went to ^he^t^w^^j^ 



Thcv were not loo Idieviiler 

|0. Y\v spilled llu' f)owder into SudiUui s w<iter trough. 

1 1. Git laughed. 

12. Let's trv Kivin^ Cliiriln*! some ovygen. 

^^. Win I guess I add(»d too nuiny clieniic<ds to the mixturi*. 
14. T<ipping tin* reader. 

One folk tale tells of the time when Tiger was not a good hunter 
and Cat agreed to teach him. Cat teaches and Tiger learns fast. 
Then when he thinks he has learned everything; Tiger decides to 
eat Cat but Cat has saved one trick. The Tiger says "/ do not know 
how to jump hac^ward" and the reader says Cat. learned in place of 
Caf IdUfihvd (example 11). 

Can we be surprised that in reading a story about a sick canary 
any modern child would suggest an aspirin (example 12)? Or, 
that in reading about a boy conducting experiments in his mother's 
kitchen, the reader might conclude that there were too many 
cyclamotes in the mixture (example 1.3)? 
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Nor vVils It siiipMsinji thdt d i olliMjjiu* from my ottico, who works 
c onstcintiv with the taprd riNulinj»s of rhildren, should havi* ri'ad a 
hiMthnj; in thr roujjh draft of this paper and concluded that I 
mispelled dipin}* (t»\ample 14). 

Ihi'si* re aders brought to thi» ri>adinn thiMr knowkulHi' of the 
world and anticipated correi tly that it would help them interpret 
the nu»ssaj»e> the author had for them. 

(pa 

I > I Uv II ()iikc\ h,Kl|il. loo. 



0 ^ 

; syntidc Inn 



l(>. Ihis thin>; sLintidc liiin so lu' doiMi't know wluil he's Siivin^. 



f 



eomcr 

I/. Pi'KKV sens^'c Hjju' ( oik tM ti in his voi( i» 



I a 



)tu' (l.u Pi'KK'^ riisliccT uf) the tront st(*f) .s ,in(l into ilu' house. 



i>pcm'(||jj^ir (li( lioiiiUA a 

X I 

JO 



I'' I i'|)('iu'(! tjju' ili( ti iMi.iis .111(1 |)i(l\C(l out ,1 word lli.it s()tin(l(*(l 
JO l\l«MHi'(l llu- ( lil). 



\Ur ImiuI oMMllowiul Lthe lu'ddinu ground iWid started up the 

iiillsidiv /a^bal^ 



JJ. . with a lon^\f)ii'( (' nt string in his hi 
flung 



J r yijc thri'W his amis liiuh and li't then] tall liniply on his l.ip. 

Whenever the reader anticipates what others do and recreates 
structures on the basis of these guesses, there have to be times 
when the reader is wrony, or when the alterations disrupt the 
structure. At these points the reader has the opportunity to pick 
up grammatical and meanin{> cues fiom the text and alter his 
or her ^uess. 

In examples I'i and lb the reader anticipated a different sen- 
tence structure: a direct object in the* first instance and a verb 
+ verb participle in the other. Corrections in such instances tend 
to be made almost immediately. The reader processes the next 
portion of text, realizes that it fails to fit structurally with what he 
or she has already produced, and corrects. 



28 CAROLYN I3URKE 



ERLC 



BEST COPY AVAILABLE 



Si»Vi»ral tv\tuii|)li»s ri'tcnii tin* KitUiinititical slmc ture of the cUithor 
but involvi* semantic tlisparity. I he length ot tUv re^iressi()ns or 
repetitions is closely related tt) the |)oint at which the reader picks 
up the semantic cue run essary tor correction and to the phrase 
structuri* within \vhi( h tln» niisciu* occurs. Voico cues coMC(»r/), 
steps cLU*s n/shed. word cues f//cf/oMcJry, i»tc. ((»\amples 17-20). 

Reco^ni/in!» that you have miscalculated is usually, but nut 
always, sufficient information for a successful correction. In ex- 
ample 21 the reackn is iiwari* tliat what fie's producing doesn't 
stnmi to make sense but is unable to come up with the expected 
ri^sponse. This is an average student in the upper grades. His 
problem is not one of word analysis on luHldin^ but n conceptual 
one concerning his limited knowledge of sheep herding. In the 
ne.xt two examples (22 and 2.J) the reader picks up the necessary 
semantic cue but supplies an effective alternate. 

ReacU»rs are at:tive producers of language. They act upon the 
structuri's and meanings of the author on the basis of their own 
language and knowledge. 

The Material 

There is no real line that can be drawn between the influences 
and activities of the author and those of the reader within the 
reading process, fkit we can note that if both the reader and the 
author are active contribi'tors to the process the possibility of mis- 
cues will increase at tho.se points where the two differ. These dif- 
ferences can involve structural and word level variations between 
and within dialects. These variations need not cause a change 
in meaning. 

24. . . . the he<ullanips of tht» ( iir . . . 
21. Wail a nionicni. 

2(). He held a hvpo(k'rniit syringe in one hand. 
27. I hc»\ put the hoses on the tire truck. 

211 I \\,!s K^)ing to hi» rea(l\ to ( ut the bitten plac t» and sik k the 
\enuni out 

flihidlifihts for /leac/Za/nps. minutv for /no/M(.'/)f, and mac/e for 
had might be considered lexical item variations across dialects, 
with hit for h/ften involving structural dialect variations (examples 
24, 25, 29, and 28). 
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J^) 1 lU' (t(K lOI ll.ul i\ ^lU'SS 

^0 .uulpi'd \Uv b\sK mis ,uul IdoImhI Ki llu* luMik^r tor inori* . . . 

" t 

^ 1 Sdnu'lliin^ w.is \Mi>n^ insuli' llmsi* huii loiis (it tirsh »uul Ixuu' 

1 ^ 

U I lu'.iril .1 imisii ill w luslli' lUMi nu viiKUhoii^lil il h.Hlionu' 

A 

In the substitutions of nvinih for ^ynn^^e and (vi^'/ne for truck 
bc^th options miyht hv dvailablo in the reader's dialect, with the 
rnisc ue representing tht» reader's preference (examples 2b and 27). 
At the structural level nulpecl clown for ^ulpi^d, bonvs for bone, 
/ thounl^t for and thnujiht, and pass mv for pass are all surface 
lev(»l Viiriationsof the author's sentence (examples 30-33). In other 
words, both the author's sentence and the reader's sentence are 
transformed from the same deep structure. 

rh(> significant point here is that the author and the reader can 
aj;ree upon the meaning and yet produce alternate structures. The 
mere occurrence of a miscue does not insure a meaning change or 
even a confusion over grammar. 

The Developmental Process 

Differences other than dialect or preference can occur between 
the author and the reader: use of unusual or complex structure by 
the author, limitations on the developing strategies of the reader, 
One interesting way to focus on these developmental differences 
is to look at the similarities and differences between miscues made 
by a number of readers on the same piece of text. 

Examples 34 and 35 were both macle by readers in the primary 
grades. They indicate how conditioned these readers have already 
become to the well-established patterns of their reading material 
e\ en to the point of expecting character names such as Little Mitten, 

Examples 3b and 37 indicate the varying degrees of success 
with which a number of fourth graders dealt with rot/^;/i and 
frcn/^i/i— words with a stK?lling pattern the readers found difficult. 
A closer look at Wctfer trough indicates the complexity of problems 
they faced. The phrase structure of noun adjunct noun is not 
a frenuent c^ne and some ot the readers anticipated a verb in the 
noun position. Those who anticipated a noun seemed to find the 
ough spelling pattern a problem. Capping this off is the fact that, 
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tor these urbcin reacliTs, trough is (jrohahly a totally untamiliar item 
so they had few or no semantic cues available for correctins- 

\A. No «)(u> viici/Tuortl* , 
\'..\ t«in hfl|) till' littk' kitti'd. 

.»> . . . the lenutli ol hi>r riuijih k'n ... 
.57. I rilliHl Hit water trough twic t'. 

Ui. HtT hu^;i' iMrs were tolded btu k tiyaihst her neck and sh(nilders. 
.^9. At sixty Krtinis of sulfd for every thousand pounds of elephant, 

it would take 480 j»rams of suha. 

Examples 38 and 39 indicate the alternatives available to a 
reader who meets an unfamiliar item. An over concern for graphic 
and sound similarity can result in the meaningless phrase hug ears, 
A focus on the larger context and meaning can result in the produc- 
tion of big ears as a useful synonym for huge ears. Similarly, the 
student reading grams as grains has indicated that while he doesn't 
recognize the term he has "gotten the message." 

The final three miscues all show groups of readers faced with 
sentence structures which they find either unusual or complex. 
The structures One day at breakfast (example 40) and After the cut 
in his allowance (example 42) seem to be difficult due to the 
placement of the prepositional phrase. The readers are probably 
much more used to finding it following both the noun and 
verb phrases. 

40. One (lav at brt-akfast his father said, . . . 

41 . [Jut hi' still thought it more fun to pri'tt- nd to he a areat sc ientist, 
mixing the stran){e and the unknownj)^.^ 
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Alter llu» ( ulCitftu^ iilloUiinccv . . . 



AltiM the ( iitlmjus cillou.iiu . . . 




Alter the ( uttnlhis tillouaiu e. 



Alter the ( iit in his .illouaiice. . . 



Alter th(» ( lit in his iillouaiu t\ . . . 

Simikirlv. theso rtM(k>rs did not anticipate strange* and unknown 
lunrtioninK in the noun ()()siti()n in the phrase mixing the sfran^e 
line/ tho unknown (example 41). They t'requently ran this sentence 
into the next one or lett it han^in^ with no final intonation in 
their search for the expected noun. 

Hsin*^ Miscue ^Xnalysis 

These reader miscues have ottered only the briefest sample of 
the possibilities that miscue analysis opens up for evaluative 
|)ur|)()ses. Furthermore, although the use of miscue analysis offers 
us a way of tap|)inH the reading process and evaluating the efforts 
of the reader, it does not automatically give us a suitable 
teaching |)r()C(>dure. 

We must begin to distinguish between reading and reading 
instruction. Reading, as an active language process between the 
reader and th(> author, must occur uninterrupted. During the 
process readers are on their own. They must handle problems 
independimtly, making the best use of the reading strategies they 
have available. 

Reading instruction is intended to focus on the use and avail- 
abilits of strategies. The purpose is not to find out Who wvnt to 
thv storv^ or Whv was fhe /)a/)v cryinf^^ or WhM did Mrs. Thoma.s 
hiiw in mind whvn she houfiht thdt hdskvt oi rod peppers? The 
pur|)ose is to support readers in discovering and develo(>ing tech- 
niques and understandings that will extend their independence and 
flexibility in handling a variety of materials. By selecting appro- 
priate text segments and producing specifically focused teacher- 
made* materials, we can highlight the various aspects of the reading 
[)roc(»ss for thi^ reiider's scrutiny. 

To restate the point: Miscue analysis can make available to us 
the information upon which reading strategy lessons are based. 
Strategy lessons allow the reader to explore specific aspects of 
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thi* riMilinH prongs. Ww siu ( (*ss oi our analysis and our instruc- 
tion is found at the point where the reader independently partic- 
ipates in the reading process. 

REFtRENCtS TO MATERIALS READ l?Y STUDENTS 

I. J. V "Kitten |i)iu»s." Hcvonc/ 7re.is(/ri» V«i//ev{M), Betts Rasic Rivulcrs. 
New York: Anicrican Hook Company. 

4. S (). 17. 21. Ml "Shivf) OoK. " Withnin}^ V'/evvs (8), Sheldon Basic 
Reading Series. Ni»\\ York: Allyn iS< Uacon, Inc . 

7. ». "A Lot to R»ll. ' Annmd Green Hills (1), lietts Hasic Readers. 
NfW York: American Rook Company. 

10. M. My r. ^8. \^}. "Zoo Outor. " T/ii» Mif^ic Word (4). Macmillan 
Reading; Pro>;ram. Ni»\v York: W.irmillan Puhlishinj» Company, Inc, 

II. 14. 18. 22, M. Vy. L\pc*rii»nce stories or teacht'r-[)roduced materials. 
12. ^2. "St)aci» Pet. ■ Thv SUi^ic Word (4), Macmillan Reading Program. 

New York: Macmillan Publishing Company, Inc. 

M. 40, 41. 42. "Freddie Miller, Scientist." Af/venf(/re,s Here and 
Thiw. iJetts Basil Readers. New York: American Book Company. 

IS, The Bi« Suriuise." Around Green H/7/.s (1), Betts Basic Readers. 
Nev>^ York: Anu»ric an B(^ok Company. 

1h. 24. 2S. 2h, 28. 2^). ' Poison." Ar/venfure.s in En^^lish literature. New 
York: Harrourl Brace lovanovich. Inc. 

V). 20. *M. 'My Brother Is a Genius." Advenft/re.s Now and Then, Betts 
Basic Readers. New York: American Book Company. 

27, "A Day At Home." Kear/zn^' Miscue Inventory: /?eac//n«s for Taping. 
New York: Macmillan Publishinj^ Company, Inc. 
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Reading Strategy Lessons: 
Expanding Reading Effectiveness 



Readins strategies are the myriad ways readers process information 
when dealinK with written lansuase. They are the methods readers 
use to construct the message as they perceive the author produced 
it. Reading strategies are natural to the reading process and occur 
continuously as the reader strives to construct the author's meaning. 

Some of the universal strategies which readers constantly apply 
include: (1) selecting graphophonic, syntactic, and semantic cues; 

(2) predicting graphophonic, syntactic, and semantic information; 

(3) confirming those predictions by asking themselves whether 
the results of the predicting strategies produced acceptable lan- 
guage; (4) applying correction strategies when the confirmation 
strategies supply evidence that the predictions were not success- 
ful; and (5) deciding which bits of information should be held in 
short-term memory for further examination and which bits finally 
should be integrated into the reader's meaning system (K. 
Goodman 1970). 

Although these universal strategies are constantly in operation, 
they take on specific characteristics depending on subject matter, 
reading format, organization, language style, and graphics. These 
variations cause the reader to apply the universal strategies in a 
unique way for specific materials. Dealing with only one type of 
written material does not help readers develop the variety of 
strategies they need in the multitude of reading tasks they meet 
in their reading lifetime. 

Reading strategies are used by all readers with varying degrees 
of success and from the very beginning of reading acquisition. 
These strategies help reduce uncertainties about new materials. 
For reading strategies to develop and become more effective, 
readers must avail themselves of all the language systems which 
can provide them sufficient clues. It is also essential that readers 
deal with natural written language. 
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When ItHuninn l.ik(»s \)Ikv in context, learners are able to induce 
their own rule systems. They cate^jorize certain items, notice how 
those items operate differently in different contextual settings, and 
organize the developing concepts in a manner that has been 
successful for them since infancy. However, when learners are 
taught specific rules without the opportunity to set up their own 
categories through contrasting and comparing in context, they are 
apt to become confused when a rule doesn't operate the way it 
was taught. For example, when the word can is taught out of 
language context, relating it to the spelling pattern of an and giving 
it the pronunciation often used in list stress like /keen/, a reader 
must reject this rule in order to read the sentence Can you put it 
in the trash can^ successfully. The question marker in this sentence 
is usually pronounced /kin/ or /kan/. The two different cans have 
no grammatical or semantic similarity in the context of 
the sentence. 

Working with natural written language, the reader relies on the 
semantic and syntactic system as well as a graphophonic system. 
The reading context is not as ambiguous as it is when isolated 
units of language are taught. In context, the reader can use gram- 
mar and meaning to decide on the connotative meaning of a 
linguistic unit and thus can approach the author's meaning more 
effectively. In natural language any single language unit may have 
a different sound, be a different part of speech, or have a different 
meaning from the way it was taught in isolation. To isolate units 
of language and teach them directly to readers confuses learning 
and increases complexity, for it creates a more abstract task for 
readers than they face with whole language. 

Reading Strategy Lessjns 

The teacher's role in reading is significant. The teacher must 
discover which reading strategies the reader is using effectively 
and which strategies the reader needs help to develop. The teacher 
should also be able to find, or write if need be, material with 
linguistic strengths that enable readers to develop effective strat- 
egies. These written materials which provide the reader with 
supportive reading are called reading strategy lessons. (Goodman, 
Burke, and Sherman 1975). Reading strategy lessons help make 
learning to read a less abstract task and make it possible for readers 
to use their language competence to the fullest as they discover 
how to become independent readers. 

A strategy lesson is a carefully constructed instructional plan 
developed for an individual reader or a group of readers. Evidence 
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that i\ iiMcler iuuhIs llu» support emphasized in the lesson could 
come from a miscue analysis of a student's reading (Goodman and 
Burke 1972). Strategy lessons help readers focus on aspects of 
written languatje they are not processing effectively. Literary qual- 
ity, interest to the reader, and significant context must be of prime 
concern even though the strategy lesson emphasizes a specific 
aspect of written language. Learning by using specifically focused 
material which is as much like "real" reading material as possible 
gives readers all the language cues intact so they can interrelate 
the specific strategy into a total language setting, 
Aln-^st all readers can benefit from reading strategy lessons: 

(1) pr .cient readers who are effective users of reading strategies; 

(2) readers who are developing effective reading strategies but 
do not use them consistently; and (3) ineffective users of reading 
strategies. 

Proficient Readers 

Proficient readers generally use reading strategies effectively 
without instruction. Reading strategy lessons help these proficient 
readers feel confident that their reading strategies are indeed 
appropriate. These readers should be encouraged to expand their 
reading experience;^. Strategy lessons for this group should focus 
on questioning the truth of what is read and deal with subtleties 
and inferences not stated by the author. Such readers could be 
provided with folk tales that retain the uncommon or archaic 
language structure of the people who told the tales originally, for 
such structures broaden readers' awareness of the rich variety of 
language possible in English. 

Inconsistent Readers 

The second group of readers shows evidence of good use of 
reading strategies, but they are not consistently proficient. These 
readers use effective reading strategies when the material is highly 
interesting to them or when it is easy because it has a low concept 
load. However, when these readers find themselves reading mate- 
rial which is complex, they use less efficient reading strategies. 
They stop searching for meaning and end up sounding out or word 
calling. When asked how they handle any particular reading prob- 
lem, such readers often say they sound words out; they may be 
unaware that they use context to read or they may believe the 
teacher disapproves of it. Strategy lessons help these readers be- 
come aware of the various effective reading strategies they already 
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use vvh(»n rciuling iMsy lUtitiMUiL |)i»rmittinj> them to transfer effec- 
tive reading strategies to more* cliflic iilt reading materials. 

One tyfu* of reading strategy lesson for such readers is a story 
with a concept or word which is proljably not well known, as 
shown in this lesson written by the author: 

llu» h()\ Wtis lookinj; tor I'l^toskics. lie Wiis walking slowlv to nitiki* 
sur(» he wouldn't miss tlu»ni, lk» usn ''.iv uhjjj^' a fuimlH»r of them 
eiU h tinu* lu» wi»nt looking; tor tlu»m. Mu»v sww not to find 
hiu ause they wvrv llu» sanu* color as tin* sand. He iMijoved looking 
for Petoskii's on llu* heacli. Hi* was liel[)in^ his mother, too, sin( e 
she used lIuMii in hi»r work. Shi» was an »irtisl and niiidi* jewelry with 
them. PiUoskies are usually l)luisli j;rav in lIuMr nalurtil stale with 
the fossils in them somewlial darki»r. \Vlu»n l\»toski^»s iire polislunl, 
thi» grav (olor liiHonies li^hti»r atui tin* fossils laki» on ii hrown 
character. l\»loskii»s are found onlv on the shores of tlu* GriMt Lak(»s. 

Put this story on an overhead projector and use it with a small 
group of read(>rs. Tell them not to worry about primouncing every 
word as they r(»ad. Cover the entire story and move the cover 
down, exposing one more sentence* with each move. As each 
sentence is t»\p()S(*d ask the children to tell what the word (point 
to Petoskies) nu?ans. After each sentence, ask the children to revise 
their guesses about the word. Do not pronounce the word tor the 
children, nor should you ask them to pronounce it. If any reader 
does say the word, the pronunciation should be accepted without 
comment. Only after the story is completely exposed and the 
meaning of Petoskies fully discussed should you ask for variations 
in pronunciation and finally tell the group how you think it may be 
pronounced. This is an interesting lesson because many teachers 
may not pronounce Petoskies the same way the people who polish 
and sell these stones do. 

Another strategy lesson for this group of readers would help 
them find ways of deciding when words are significant and their 
meaning should be pursued, and when they are insignificant and 
can be omitted without losing a great deal of what the author 
wants to say. Such a strategy lesson can be written by the teacher 
or can be found in available reading material: 

All tht» Christnitises roll down toward tlu> two-tonguiul sim, lik(» a 
(olcl and headlong moon bundling down the sky that was our street; 
and tht»y sto[) nt the rim of thi» ice-edged, fish-lrinvin^' wavc»s, and I 
[)lungt» my hands in the snow and l)ring out whatever I can find. 
In g(u»s my hcind into that wool-whiti» Ijell-tongui^d l)all of holidays 
resting at the rim of thi» ( arol-singing sea, and out cotiies Mrs. Pro- 
thero cind the firemen (Thomas 19^)4, pf). 'i-b). 
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The rOiUlinH of this sriuction should he followed with discussion 
questions: Which words or phrases can you leave out and still 
get enough out of the passage to understand what the author 
wants you to know? Are some words or phrases meant to bring out 
feeiings in you rather than for you to understand their exact 
meaning? How can you tell? 

. It is a significant insight when students realize that all readers 
make judgments when they read. They make judgments about 
what is significant and needs to be understood immediately; what 
may be felt and not fully understood; what can be actually omitted; 
or what can be not understood at all but kept under wraps for 
another time when the same concept reappears in a richer context. 
Readers must also understand that they are the decision-makers 
at each of these steps and no one else can make these decisions 
for them if they are to become independent readers. 

Another strategy lesson makes use of material in which certain 
words or phrases unknown to the reader are eventually explained 
in the context. The reader must read on so the author's use of 
appropriate redundancy in written language can provide the reader 
with additional meaning cues. Again, the teacher can write such 
a story or find one in ready-made materials: 

In the high and far-off times the elephant, o best beloved, had no 
trunk. He had only a blackish, bulgy nose as big as a l iidt that he 
could wriggle about from side to side; but he couldn't pick up things 
with it. But there was one elephant— a new elephant— who was full 
of "satiable curtiosity/' and that means he asked ever so many 
questions (Kipling 1%5, p. 63). 

Inefficient Readers 

The third group of reader; needs help in realizing that the 
purpose of reading is to gain meaning for one's self and not to 
complete a task in a way specified by a teacher for an unknown 
purpose (Watson 1973). For a variety of reasons the development 
of effective reading strategies is disrupted for such readers. I hey 
use effective reading strategies occasionally in short phrases or 
sections of written material, but in most reading situations these 
readers tend to omit words they think they do not know; they do 
not predict acceptable grammatical or semantic structures as they 
read; they read word for word using sounding out techniques 
without concern for meaning. They do everything they were taught 
to do in an isolated and unrelated fashion. They lock for little 
words in big words and find fat/her an acceptable solution for 
father. They separate words between two middle consonants and 
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often read lit/tul tor littiv and pr/t/tee for prvtty. When they do 
make occasional effective use of reading strategies they lack con- 
fidence in deciding which strategy is most effective. They regress 
and correct in situations when it is inefficient to do so. For example, 
if such a reader reads can't for cannot because of the use of an 
appropriate predicting strategy, this is corrected when the reader 
picks up additional graphic cues. Such readers often think that 
graphic input is the most significant aspect of reading. Reading is 
not to discover something new or for enjoyment, it is to satisfy 
another person. 

The first step for such readers is to realize that they are effective 
users of language and that being a language user can help in 
reading. Using a modified cloze procedure as a strategy lesson 
may help such readers b^^come confident about their ability to 
use context to predict and guess at missing units: 

"Help!" said Andy. "Help! H^lp!" 

Dan and Hill came fast. They saw Carlos down in the water. 

"Watch out!" said Dan. "That is after you!" 

Carlos splashed and splashed the water at the to get it 

to go away. The did not like the water splashed at it. 

It swam under the water away from Carlos. Then Carlos swam fast 
through the water to the boat. 

"Fast!" said Dan. "Help pull Carlos back up on the boat. The — 

is coming back!" 

The men helped Carlos out of the water. 
"Are you all right?" said Dan. 

"I am all rifiht/' sdid Carlos. "Bui that was after me. 

It was a good thing it went away when I splashed water at it (Berres 
et al. 1959, pp. 24-25)." 

Selecting the grammatical item which will be missing should be 
done carefully for these readers. They should be given only highly 
predictable blank slots in the first few strategy lessons, since the 
most important first step is to build self-confidence. 

Because ^hese readers concentrate on the relationship between 
letters and ; )unds and minimize the use of grammatical and 
semantic i'^formation, they often develop habitual associations 
between words or phrases that have close graphic and phonemic 
similarity. Examples of such habitual associations include for for 
from, saw for was, through for thought and this is for is this. 
The best way to help readers break down habitual associations is 
to prepare strategy lessons that carefully conuol the linguistic 
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si»ttinn so only oru' ol tin* two hi^hitually c^ssociated items can 
fit the nuuuiitiH. Ilu» tnaterial must In* within the experiential 
understandinf} of the readers so that the error is obvious if they 
read the inappropriate term. 

The developmental sequence of a strategy lesson plan which 
would break down hal)itual associations includes: (1) Write an 
experience story to elicit the p.uticular words the child or children 
should think about. For example, if a reader or small uroup in a 
class hiibitually associates was and saw, tlie teacher might sugfjest 
writing an experience story about the tour of the school the stu- 
dents took the previous day, emphasizing what they saw on the 
trip yvstvrdoy. This would cause the students to use the word saw 
frequently during dictation and would cue them to read the word 
saw when they read the experience story. (2) Find or write a story 
with only one of the habitually associated words used frequently 
in an unambiguous language situation. A few sentences from such 
a story miglit be: ")ohn looked up and down the street. He wanted 
to tell his father about the good news. When would his father 
corned Finally, as he looked down the street, he saw Father com- 
ing." In this setting, if the reader is focusing on understanding, 
the clause hv saw father could not possibly be read he was Father. 
(3) When the Yeader ot readers show evidence of handling one of 
the habitually associated words, write or find some material where 
the other habitually associated word is used in grammatical set- 
tings whose context builds toward the appropriate word so the 
confusion will be less likely to occur. (4) Encourage the students 
to read in regular situations to see if they have developed the 
effective reading strategies needed to handle the habitual 
association. 

In summary, strategy lessons help readers develop appropriate 
reading strategies in a context of unambiguous language so readers 
have the support of meaning and grammatical systems to help 
them predict and confirm. Teachers are the key to the instruction 
program suggested here. They need to know what kinds of support 
readers require and how to select and write material to best help 
develop effective reading strategies. They must supply readers with 
appropriate language settings through which the readers can in- 
duce their own rule systems. The need for teachers knowledgeable 
al)out language, how language is learned, and what the reading 
process is like, becomes crucial. Such a teacher is the single most 
important person helping students learn to read effectively. 
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3 Miscue Patterns 

The Relationship of Beginning 

Reading Instruction and Miscue Patterns 

liiyno A. DvLawtvf 



Miscue research is the focus for an increasing number of studies 
in reading}. A miscue is an unexpected oral reading response (K. 
Goodman 1965). Proponents of miscue research assert that the 
study of miscue patterns leads to greater understanding of the 
reading process and, in turn, to improvement of reading instruction 
for children (DeLawter 1970; K. Goodman ^9h9; K. Goodman and 
Burke 1970; Y. Goodman 1970). 

Until now, however, most miscue research paid little attention 
to school children's previous instructional experiences. The use- 
fulness of this research is consequently limited unless possible 
sources of miscues are more thoroughly investigated. The inter- 
relationrhip among formal instruction, experience, and miscue 
patterns warrants attention in order to clarify miscue findings and 
to provide guidance in instructional planning. 

For example, at the present stage of miscue research, it is dif- 
ficult to determine whether a miscue pattern demonstrates a lack 
of exposure to or minimal competency with a particular strategy^ 
an overlearned or overused strategy based on previous instruction, 
or a stage in the development of reading competence. Planning 
appropriate instruction at any level of competence would be 
greatly facilitated by knowledge about the sources of miscues. 

In addition, a study of the interrelationship of miscue patterns 
and instructional methodology might provide insight into general 
school performance, i.e., the ways in which strategies and attitudes 
children acquire in their central primary school experience- 
reading- are carried over into other tasks and areas. 

Barr, in a study of the relationship of word recognition errors and 
instruction, finds evidence that instruction does influence reading 
strategies in predictable ways. As she acknowledges, though, her 
study was limited to words tested in isolation rather than context, 
and her data were collected after only a brief period of instruction. 
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Shr suHtjests tho fuu»(l lor lurth(»r ri^soarrh which assesses "the 
eth»ct ot ditUTtMit instruction on children's reading strategies over 
longer time periods using contextual materials (1972, p. 527)." 

Independently or I3arr's work, the present study was undertaken 
to determine if a relationship between beginning reading instruc- 
tion and patterns ot miscues could l)e shown to exist over an 
extended period of time. 

Description of the Study 

One hundred sixty-nine children were involved in the study. All 
were second graders in New York City public schools located in 
low income areas. The children had participated in a large research 
project* for two and one-half years and had received specific 
reading instruction in first and second grade in one of two 
reading approaches. 

One reading approach incorporated "linguistic materials with 
an emphasis on decoding and no emphasis on meaning of any 
kind (Goldberg and Taylor 1969, p. 1)." This program was derived 
from the Allen and Allen Read Alons W/fh Me materials which 
served primarily to familiarize children with the regular spelling 
patterns of English. 

In classroom exercises, nonsense responses were acceptable 
when they indicated a child's use of appropriate sound-symbol 
relationships. The content of the stories was less important than 
the practice the stories offered in decoding. Two reading series 
which controlled vocabulary on the basis of regular spelling pat- 
terns were used: the Miami LinguisttC Readers and the Merrill 
Linfiuistic Readers. 

The second reading program followed a sight word approach, 
incorporated in a basal reader series, the Chandler Language Expe- 
rience Readers, These materials emphasized multi-ethnic 
characters and stories cast in an urban environment. They sought 
to use vocabulary and sentence patterns cliaracteristic of children's 
natural oral expression. These were derived, in some cases, from 
transcriptions of actual recorded conversations. 

Photographs of city life were included and boys played impor- 
tant roles in many of the stories. Typical of basal series, the content 
of the stories was heavily emphasized, pictures were primary clues 
to meaning, and word identification skills were largely peripheral 
in the presentation of the stories. 



•The HcuinniriM RiMclinji Projei I. dirot tccl hv l^r. Miriam GoldhcTU. Wtis sfmnsorod 
l)V the Center for Urban tductition and tetichers Collejie. Columbiti University, 
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Ot the s(»vi»n r(»<uiinn at)t)r()ac:hes used in the Beginning Reading 
Project, these two programs (hereafter, ''decoding emphasis" and 
"meaning oriented") were considered to be at opposite ends of the 
continuum with respect to the importance of meaningful content. 

A check was made on instructional methods used by the second 
grade teachers. Sufx^rvisors in t?ach school were asked to match 
participating teachers with one of two prepared lessons. The lesson 
selected was to be typical of the teacher's usual reading lesson in 
content and procedures. There was only one mismatch in the 
group of 11 teachers. 

For this study the children read 30 test words presented In Isola- 
tion or in context. These words, all of more than one syllable, 
did not appear in the formal instructional program of either of the 
reading approaches for first or second grade mastery. 

In the context presentation, the test words, used as nouns, were 
embedded individually In sentences which provided relevant clues 
to the meaning of the words but did not limit logical responses to 
• those words. Substitution of other words could result in meaningful 
but inaccurate sentences. 

Table 1 

Percentage of Nonword and Real Word Miscues 
by Instructional Group 

Miscuc Decoding Group Meaning Group * 

Isolation Context Isolation Context 

and Context Only and Context Only 

Nonword 70 hS 41 46 

word m 59 54 

Total 100 100 100 100 



Table 2 

Percentage of Miscues According to Quality 
of Decoding by Instructional Group 



Qualitv of 


Ot'coding 


Meaninj; 


fit'( r)(linj> Attempts 


Croup 


Group 


Good 


.n 


15 


Fair 


.V\ 


21 


Poor 


.18 


. M 


Total 


100 


100 
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Each child vViis tested lor about 15 minutes on either the isola- 
tion or context presentation. Sessions were tape recorded and re- 
sponses were also noted on a record sheet by the examiner. 

Miscues were classified as substitutions or omissions. Hypoth- 
eses were tested with chi square tests of independence. Additional 
analyses were performed on the substitution errors from a ranckim 
sample of 24 protocols from each instructional group. Frequency 
of real word miscues, quality of decoding attempts, and relevance 
of real word miscues to their context were evaluated. 

Results 

Patterns of Miscues. Miscues, both words and nonwords, were 
made by children from both instructional groups. However, the 
groups demonstrcited di'ferent patterns of miscues. The decoding 
emphasis group offered about twice as many nonwords as words, 
while the meaning emphasis group had a higher percentage of 
real word miscues than nonwords. These trends were present in 
both types of presentation. (See table 1.) 

When miscues were evaluated with respect to the quality of 
decoding,* children who had been taught by the decoding em- 
phasis demonstrated over 60 percent good and fair attempts. The 
majority of m^scu^s {\A percent) made by the meaning emphasis 
group were classified as poor attempts. (See table 2.) 

Several individuals demonstrated patterns of miscues which 
indicated overuse of strategies stressed in their reading lessons. 
For example, the decoding emphasis approach suggested instruc- 
tional activities in which children read lists of rhyming words. 
New words were introduced in this way and nonsense forms were 
frequently included on the lists to check for decoding ability. 

When asked to read the words presented in isolation, several 
children taught by this method read the test words (none of which 
rhymed with each other) as if they were rhyming words. The 
following responses made by two children illustrate this occurr^^nce: 



shoulder 

superintendent ■ 

pilot 

station 



spook 

— rink 

- pink 
skook 



poison — 
correction 
secretary- 
stadium— 



- pon 

- ron 
-- son 
stom 



•Cati^orins for cvtituntinw H(>( odin^ ijttcmpts wvro ^ond (use of ^raphophonic ole- 
nicnl> and svllahU tition similar to ihv test word), fa/r (usi* of a tVw ^raphophonir 
^'l(»m(>nts). poor (use ot initial sound ontv: response with little or no apparent 
^»raf)hof)honi(' res(»mhlance to the test word). 
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AppcUunllv ilu'sc children noted some of the graphic features 
and responded to the task in a way that was similar to their class- 
room reading experit^nces. 

Patterns of miscues anions children taught by the meaning 
emphasis approach did not as dramatically illustrate specific strat- 
t»gies. These children did tend to offt^r hasty responses, while 
children in the decoding emphasis group frequently took longer 
attempting to figure out unknown words. 

Syntactic Accvpt ability. In the context presentation for both in- 
structional groups, most of the miscues that were real words fit 
into the syntax of the sentences. In fact, even some of the miscues 
which were judged syntactically unacceptable fit with the preced- 
ing syntactic context, though they were not acceptable in the total 
sentence. For example, in number 5, the word sensible is not 
sufficient to complete the sentence. However, it is not a com- 
pletely inappropriate response, since it would be acceptable if 
followed by a noun. 

No patterns emerged which differentiated the groups on the 
basis of syntactically acceptable miscues. The following examples 
illu.strate word miscues made by children from both groups (mis- 
cues are italicized and test words are capitalized)^ ^ 

Acceptable 

1. The boy had to wait for a c/iance (MINUTE) before he could get 
on the bus. 

2. The man standing by the plane is a policenian (PILOT). 

3. The clothes were very dirty, so Mother used deodorant (DETER- 
GENT) lo wash them. 

4. Mr. Stone didn't shave for three weeks. Now he has a real 
noisy teacher (MOUSTACHE). 

Unacceptable 

5. The teacher told Tom to take the note to the office and give it 
to the sensible (SECRETARY). 

b. Mike is a boy all the children like. He doesn't have any en)pty 
(ENEMY) in the class. 

Semantic Accentability. For both groups, about half of the miscues 
that were real words were judged relevant to the meaning of their 
context. As indicated earlier, the majority of miscues made by the 
meaning oriented group were real words, while the majority of 
miscues made by the decoding emphasis group were nonwords. 
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1 hiMotort*. tin* cu lUiil tiuinluT ol niis( ci(»s vvhidi vvoro semantic ally 
cu:c t»()tablt» was hij»tH?r lor lht» nnMninj; oritMitcnl yroup. 

The following scMitences include (examples ot semantically 
acct»ptal)lf misc urs: 

1. That costs too much. I only have a r/n//ar (QUARTER). 

2. A window in our a()artni(Mit was l)r()ken, so we called the 
window iisvr (SUPtRINl ENDtNT). 

3. When Ann saw a rat, her mother said, "We ni?ed some mousv 
traps (POISON)/' 

4. The teacher told Tom to tak(» the ncHe to the office and ^ive it 
to the principal (SECRETARY). 

5. Since it was raining, the game couldn't be playc^d in the sunlight 
(STADIUM). 

b. Nobody was hurt, but a lot of windows were broken during 
the //re (RIOT). 

7, Mr. Stone didn't shave for three weeks. Now he has a real 
lH\ml (MOUSTACHE). 

Some examples of miscu(»s which were judgt^d unacceptable: 

1. You can trust her. She won't break a problem (PROMISE). 

2. Ted rod^> his birthday (BICYCLE) on the path. 

i. While the man was taking pictures, he dropped his camp 
(CAMERA). 

4. When they were married, they had a big window (WEDDING). 

« 

5. The shop was burning! Firemen rushed to the rubbvr (RESCUE). 

SummcUY' The majority of miscues made by the decoding em()hasis 
group were nonwords which resembled test words closely in 
graphic/sound elements. Almost all of this grou()'s real word mis- 
cues were syntactically acceptable and about half of them were 
semantically acceptable. 

The majority of miscues made by the meaning oriented group 
were real words which were not especially close to the graphic/ 
sound elements of the test words. As with the other group, almost 
all r(»al word miscues were syntactically acceptable and about 
half were semantically acceptable. 

Limitations 

This study, as an outgrowth of the larger Beginning Reading 
Project, was limited by the complexities inherent in longitudinal 
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ros(Mr( li (MIorts in (ontfnifnuciry urban schools. Despite regular 
projoct totuhrr tnnninK sessions, cicissroom visits, and formal 
observations, it is ditlic ult to state with certainty the decree to 
whic h the reading programs were carried out as intended. 

Di.scussion 

This study sought to ansvviM* thesi> ((uestions: are there clit- 
terences in niiscue patterns amony children taught by different 
beKinniMKreailinK approaches^ What is the nature of these miscues? 

Tht» data from the study suyyest that thert* are miscue patterns 
which af)pt?ar to bt> directly related to be^inninK reading instruc- 
tional af)f)r()aches. These f)atterns are consistent with the different 
(Miiphasisof each instructional program and demonstrate strategies 
that are predictable, ^iven particular instructional emphases. 

Significantly, the miscue patterns distinguish the two groups 
after two years of reading instruction. A child's experiences over a 
f)eriod of tirni* mi^ht be expected to lessen the recognizable 
(effects of specific reading instruction because he or she has had 
time to personalize and modify the strategies. The fact that the 
patti»rns are still distinguishable in spite of these other influences 
reinforces the findings of the study. 

The m^scvw v>?in\>in?» ol ttie two groups dinered most strikingly 
with regard to the frequency of miscues (1) which were real words 
and (2) which w(^re similar to the graphic/sound elements in the 
test words. Children taught by a meaning oriented approach tended 
toward miscues which were real words, while those with an em- 
phasis on decoding produced mostly nonword miscues. 

The fact that real word miscues offered by both groups fit the 
context only about half the time has clear instructional implica- 
tions. It suggests the need for instruction which helps children 
realize that they are not "reading" if the words they are saying 
aloud or thinking do not make sense in the context. Indeed, only 
as far as they are aware of the meaning of the [)assage will individ- 
ual words be significant. 

There are few ri^ading approaches which suggest actual sys- 
tematic strategies for "reading for meaning." Although this phrase 
has become a popular cliche, its meaning is still rather vague. 
Good teachers may ask children if a certain word makes sense in 
a passage, as did several teachers in the meaning oriented approach 
in this study. They may also ask for a retelling of the selection 
to evaluate the extent of the child's understanding of it. However, 
because reading is commonly seen as an accumulation of skills 
and because "meaning" is such a personal and mysterious concep- 
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tual experience, tew iv»il stratofiies other than these have yet 
been devised to help children reconstruct meaning from 
printed materials. 

The data from this study show that children from both instruc- 
tional groups made few real word miscues that interfered with or 
changed syntax. This finding may bo a function of the syntax 
provided in the test situation. It might also be related to the 
nature of syntactic systems. 

In this study the test words, used as nouns, appeared near or at 
the end of individual sentences. These statements were not re- 
lated to each other in any meaningful way. Children may have 
gotten used to this grammatical pattern as they read the items. 
If so, implications regarding syntactic patterns would require 
further study. 

Another explanation might be that the two instructional ap- 
proaches were neutral about syntax. It is generally accepted that 
children acquire control over grammatical conventions before 
they begin formal reading instruction. Perhaps the conventions 
are so firmly established that instruction in reading of the type 
reported here does not affect them. 

The strength of the syntactic component should be viewed as 
a bonus for teachers. Grammar, a highly constraining s\steni, can 
be used actively as a strategy for generating meaning. Children 
should be helped to use more consciously their already developed 
language abilities as they read. 

The finding that patterns of miscues relate to instructional 
approaches has important implications for diagnosis. If particular 
patterns of miscues are noted for a specific child the diagnostician 
should immediately check the child's previous instruction. If the 
patterns are consistent with the instructional approach, the di- 
agnostician will have valuable information. The patterns suggest 
that the child has indeed learned reading strategies, but for some 
reason is unable or unwilling to use them appropriately. This 
knowledge would guide future instructional planning. For example, 
the diagnostician could then identify new strategies and new goals 
which do not duplicate previous activities. 

If the child's pattern of miscues is not predictable from previous 
instructional experiences, different kinds of questions would need 
to be asked. For instance, did the child receive instruction in a 
particular strategy? Was the child absent when key strategies were 
presented? What is the child's preferred sensory modality? What 
are the characteristics of the instruction that apparently was not 
learned? 
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The ways in vvhic h findings from thh Miidy can be used depend, 
in part, on children's sUxuvs of development. Some miscues are 
more reasonable at one stage than another. There is a need for 
further study to clarify the relationship between cognitive devel- 
opment, instructional experiences, and patterns of miscues. 

Other areas for further research are also suggested. A similar 
investigation using longer, more varied reading selections mi«ht 
be conducted with young children. A study with older children 
might determine whether strategies taught in their beginning 
reading programs were still evident. 

Another study might look at the degree to which children 
generalize the strategies they learn in specific areas like reading. 
The present findings suggest that learned strategies are persistent; 
it is reasonable to ask how they affect other curricular areas and 
ways of approaching problems. For instance, is a meaning oriented 
approach in beginning reading more likely to encourage critical 
thinking and personal interest in reading for pleasure? Does a 
decoding emphasis in early instruction lead to highly organized 
and precise ways of approaching problem situations? Findings 
such as the ones discussed could bring perspective to the rather 
limited current emphases in reading instruction. 
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A Different Look at Reading 
in the Content Areas 

Kvnnoth i. Cirlson 



School rt^adiriK proHmms have developed on a twofold premise. 
First the child learns to read, and then the child reads to learn. It is 
assumed that reading instruction enables children to develop the 
ability to read in a variety of content areas. 

Educ ators, however, report that many children seem to be able 
to read and comprehend grade level material in their basal readers, 
but they appear to lack the skills to read and comprehend subject 
matt(»r texts for the same grade level. Many educators suggest that 
the readability of content area materials requires closer scrutiny 
because it may actually be higher than publishers designate. Some 
educators question the conceptual load of such materials and 
suggest that too many ideas new to the reader may be involved. 
All seem to agree that many elementary and secondary students 
have difficulty reading content area material. 

Textbooks on reading instruction seldom cite research as a basis 
for the suggestions offered teachers who deal with reading in the 
content areas. Durrell (1956) emphasizes the idea that the critical 
thinking ability of the reader determines how well he or she reads 
subject matter. He considers critical thinking abilities important 
for reading in the content areas. The reader must be able to select 
material pertinent to a topic or particular occasion. He or she must 
be able to find exception with the author's viewpoint, distinguish 
sense from nonsense, sort fact from opinion. Critical reading 
includes finding differences in viewpoints, noting the author's 
bias, and locating exaggerated statements and unfounded claims 
(pp. :i05-307). 

Some Old Studies 

Gray (1960) reports "a range of correlation coefficients from .22 
to 70" in early studies comparing reading achievement and scho- 
lastic standing (p. 1126). Bond and Tinker (19^7) report that "the 
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corrtHiUions brtwi'cn ^^(MiiMiiI rtMdinK tests and reading tests in 
the content tielcis ranye tron) about .30 to ,50 (p. 352). " Traxler 
(1957), however, states: 

Tlie i'\istem i» of si^iiiti( .int |)ositiv(» i oinH.ilion l)(>t\ve(»n rcMdin^ 
•il^ilitv and acliieviMiient in a sul)ji»( I n«»ld docs not ru'cess.irilv 
nu'.in th.it ini[)r()viMnent in redding al)ilitv will result in iinf)i()ve(l 
lU'hievement (p. 0). 

Summers (1957) reports that recent studies of reading in the 
content areas used "unique or more sophisticated measuring tech- 
niques ipp. 137-138)." He summarizes a study where one researcher 
used an introspective technique to stiidv how students viewed 
reading ditficulties in subject matter areas. Catone s doctoral re- 
search (1966) also focuses on asking students to communicate 
information about their reading process as they read literature and 
science material. Smith and Dechant (1961) emphasize that a 
variety ot reading skills are required in subject matter reading. 

A survey of reading research in the content areas reveals that the 
majority focus on such factors as paragraph meaning, readability 
factors, growth in reading and subject matter achievement, and 
the effects of varied instructional methods on comprehension in 
content subject;*. The research reported in the literature is con- 
cerned with measuring the results of the reading process after 
reading subject material rather than studying the reading process 
as it is applied by individual readers (Traxler 1941; Traxler and 
Townsend 1946, 1955; Robinson 1962-65; Weintraub, Robinson, 
and Smith 1965-70; Weintraub et al. 1971-73). 

Two New Studies 

In 1970 ihis writer conducted a study of reading in the content 
areas that focused on analyzing the* process that readers used as 
they read various subject matter (Ct^rlson 1970). A small group of 
fourth grade students orally read two basal reader stories, two 
social studies selections, and two science selections, all taken 
fro n materials new to the readers. The oral readings were tape 
recorded to capture the oral reading miscues for analysis. At the 
end of each selection the child was asked to recall and retell the 
selection orally, permitting an analysis of the reader's comprehen- 

,\, This, too, was recorded, 

he reading miscues were analyzed using the Gooc/man Taxon- 
on- » r 'Kk dding M/scue.s (K. Goodman 1969). This taxonomy is a 
p^ !iJ linguistic research instrument. It includes categoric*; such 
as phonemic and g^^phemic relationships, morphemic considera- 
tions, grammatical function, and syntactic and semantic accept- 
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dhilily. Mis( lie |)jlliMris in tin? various contont siHections wore 

Kolc/ynski (197.5) c:()m|)Uue(l ,\ sirnilnr rosonrih study. He i\n- 
dly/iul tin* riM(li»;s' uso ot syntcu tic and semantic cueing systems 
in their vtinrt to gjin mejninj} from literature, science, social 
stuiiiivs, cuui mathematics passages. He uschI the Riwdi Miscuv 
Invvntorv (Y. Goodman and Burke 1972), which is a shorter version 
ot tlH> CiUHlnhin T.wononw ot Riwdin^ Miscuvs. 

Hoth research studies assumed that reading is not just a process 
of matching sound with symljol, but involves the interaction of the 
reader with the language of the printed page. The reader uses his 
or her memory l)ank of conce|)tual ex|H>rience and language knowl- 
oi\*j,v in an atttniipt to comprelnmd thi? written message encoded 
l)y the author. As the reader interacts with the printed page, he or 
she |)redicts and anticipates what language structures will be used 
to transmit the intended message.' A reader becomes increasingly 
[)rotit !»»nt as he or she increases in ability to reconstruct meaning. 

Reconstruction of meaning involves reading the signals of at 
least three distinct but interrelated cue systems. The reader is 
( utul by gra|)hophonic, syntactic, and semantic information. If the 
reader successfully |)roce.sses this information and correctly antic- 
i[)ates the language of the |)age, no deviation will be noted. How- 
ever, wh(Mi the readei misprocesses or the prediction deviates 
from the cues on the page, he or she produces a miscue. A miscue 
is defined as any deviation from the expected response to the 
printed page. These miscue phenonnma form the basis for these 
two studies, which provide some additional insight into the com- 
plexities of the reading |)rocess and give us a perspective that 
f)i?rmits a different look at reading in the content areas. 

Summary of the Findings 

The readers in the Carlson and Kolc/ynski studies exhibit the 
yreatest similarity when reading basal reader or literature selec- 
tions, which may be a result of the instruction th(»y received. 
Analyzing the miscues reveals several patterns. The majority of 
miscues in all the reading selections show a high degree of partial 
or full syntactic acceptability and a medium or high graphophonic 
similarity. A large number of miscues are totally syntactically 
acce[)table and show slight oi no syntactic change. This indicates 
that the subjects used syr)tactic information to cue them in 
their reading. 

Then* is a tendency for miscues with partial or full semantic 
acceptability to have medium or high grapho|)honic similar ^^v. 
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Suhjocts UmuI not to sell ( ornu t niisciu^s tlnit an? |)artially or 
totally stMnanticaliy ac(o|)tal)k». Tlu^ri* is a strong tiMuhMK y for 
miscuus to have tin* samo Hramniiitical function as the ox[)(H:tocl 
text response. 

Although subjects (»\liihit tlie Hr(»at(»st siiniiaritv on basal reading 
selections, it is at)t)ar(MU that the subjects' ability to read '/otitent 
area materials cannot easily punlicted from their performanc e 
on basal reader material. There is little relationship between the 
subjects' miscues |)er hundred words and their comprt^hension of 
the selections. All subjects tended to use j^raphophonic cues to 
aid them with all types of materials; similarly, these subjects made 
extensive use of syntactic and ??emanti(: cues to gain meaning, 
regardless of content area. 

Previous writings on reading in the content areas have assumed 
that readers need to shift their modus operandi when reading 
different subject matter. These studies suggest that the reading 
proc(»ss remains relatively stable across passages from various 
content areas. 

Implications 

For the most |)art, the conclusions drawn from the data in the 
Carlson and Kolc/ynski stLidies closely ()arallel the results of related 
research using the Goodman Taxonomy of* Keaditifi Miscues and 
the Rvddina Miscuv Invvntory as a basis for data analysis (K. 
Goodman and Burke 1968, 1969, 1973). The assum|)tion that 
reading is a psycholinguistic process is apparently further substan- 
tiated by the results of these studies. 

Reading is a language process to which readers contribute in- 
formation from their knowledge of language and their experience. 
When this information closely matches the language usage and 
experiences of the writer, a meaningful reconstruction of the 
intended message takes place. If this description accurate, the 
present methodology of so-called developmimtal reading instruc- 
tion needs critical examination. Much time and energy is now 
being devoted to reading instruction in basal r(»ader programs. It 
may be that the rigid structure in such programs does not lead to 
as broad a development of reading behavior as educators once 
believed. 

It has been hypothesized that the? careful regimi^nted pattern of 
basal reading instruction will eventually lead to development of a 
broad base of reading skills that will enable the reader to process a 
variety of contexts and grammatical structures. Indeed, this may 
not be the case at all. Perhaps the current methods of basal reading 
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instrurtion, wlicn tollovvud too rigidly, are rather a type of con- 
trolled r(»tarclation. In any case, further examination ot current 
practices and the results ot present-day reading} instruction 
is required. 

Onv of the practices that must be examined furth(»r is the word 
analysis program in developmental reading instruction. Most of 
these programs consist mainly of phonetic and structural analysis 
methods t)f word identification; almost all basal reading programs 
have a hi^h decree of vocabulary control. The sraphophonic cue 
system is useful in reading, and mature readers exhibit consid- 
erable mastery in usin^ this cue system as they read. However, 
when phonics instruction and development of siyht vocabulary 
are isolated elements in reading instruction, pupils may consider 
them separate rather than related elements. 

An overemphasis on phonics instruction and too yreat a concern 
for mastery of the controlled vocabulary in the basal reading 
program can limit, rather than extend, the reading skills of young- 
sters. The exclusive use of the graphophonic cue systei.i may 
encourage maturing readers to rely on a method of word iden- 
tification that probably can only be partially successful at best. 
These content area studies seem to indicate that the readers re- 
sorted to a graphophonic approach when the reaJing became 
difficult for them: to some extent they seemed to follow the rule, 
"When in doubt, sound it out." These readers also showed a strong 
reliance on syntax to cue them as they read. 

Of course, sight vocabulary develop^jJKyjJ is necessary if a young- 
ster is going to develop into a mature re.|j;^»r, tftjt too often the 
approach is more like exposure to a printed symbol nr inched by the 
utterance of the verbal label for that symbol. Thus, children are 
shown f-o-h-a-c-c-o and told that the word is tobacco. All too often, 
the instruction does not include a variety of strategies that focus 
on a fuller understanding of the concepf of tobacco. Unless the 
conceptual aspect of vocabulary development receives attention, 
students may be left to their own devices to assimilate the seman- 
tic input needed to read content area material. 

Recommendations 

Several recommendations can be made to classroom teachers 
and curriculum directors. There should be careful analysis of 
content area materials used for instruction. It is insufficient guar- 
antee that publishers designate materials as suitable for students 
in a certain grade level; such materials must be tried out on a 
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pilot basis to sm? it ( hildrod t an handle the syntactic and semantic 
information with relative ease. Children appear to rely on syntactic 
cues to aid them in reading as much as they rely on graphophonic 
information. Teachers should be aware of this and provide instruc- 
tional strategies that encourage children to make effective use of 
such cues as they read. 

Considerable time and energy is spent planning and conducting 
directed reading activities with basal reading materials in upper 
elementary classrooms. It may be wiser to reallocate at least some 
of this time and energy to reading instruction with content area 
materials. Particular attention should be given to helping children 
understand the concepts presented in such materials. Teachers 
should observe and analyze childr(.n's miscues on a regular basis; 
the tape recorder provides an effective and economical way of 
recording children's reading so teachers can analyze it later. Selec- 
tions should include samples from content area books, for such 
analysis can provide the teacher with information about the 
children's strengths and weaknesses that will permit appropriate 
individualization of instruction. 

Instruction in content area subiects cannot be limited to a single 
textbook. A wide variety of reading materials should be used to 
meet the reading needs of children with different interests and 
varied experiences. Teachers should use real life experiences or 
provide vicarious experiences with films, pictures, and simulation 
activities in coniunction with oral discussion to allow children to 
exchange ideas. Such activities are necessary to develop fully the 
concepts presented in text material. 

Conclusion 

The so-called reading to learn phase of reading development 
does not seem to be exhibited very well by the subiects in these 
content area studies. Serious consideration must be given to 
current approaches in content area instruction as well as reading 
instruction. Guidelines should be developed for analyzing, 
selecting, and producing content area material for instructional 
purposes. 

Reading \s simultaneously a sensory process, a perceptual proc- 
ess, a linguistic process, and a cognitive process. Thus, the reading 
process is psycholinguistic by nature. Further research investiga- 
tions must not ignore the simultaneity of these elements. To in- 
vestigate only the sensory or perceptual aspects of the reading 
process without some concern for the linguistic and cognitive 
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asfUK ts only |HM|H»tUiito some of tho simplistic notions that 
dlready pernuMtt? the rest^arch literature. Reading is indeed very 
complex and otily by researching the entire process will researchers 
Hain valuable insights. 
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4 The Cloze Procedure 

Literacy in the ClassroonV 

lohn K. liornnith 



Children in school depend on their reading; skills for academic 
survival. In the primary f;rades they read mainly to practice the 
reading; skills they are learninR. But as they enter the upper grades, 
their curriculum changes, dealing less and less with the basic 
reading skills and more and more with the serious business of 
learning how to live in the worid they were born into. We have 
long believed that reading ought to be the most economical and 
efficient way for children to learn that content. Consequently, 
from about grade four onward, students are expected to acquire 
ever increasing amounts of knowledge and are expected to acquire 
that knowledge in ever increasing proportions by reading and 
comprehending written instructional materials. 

However, when we planned things this way we may have mis- 
calculated by assuming that students would be able to compre- 
hend the instructional materials provided for them. In one study, 
I have found that 65 percent of the students in the upper elemen 
tary grades gained little or no information from the average text- 
book used in their instruction. In the junior high and high school 
the situation improved, but the proportion was still 40 percent. 
A recent city-wide survey in Madison, Wisconsin, obtained similar 
results. These data show what a lot of teachers have known for a 
long time— that textbooks are often so difficult many children 
learn little or nothing from them. 

And that is what this paper is about: how a teacher can improve 
the effectiveness of the written instructional materials in the class- 

*A iiKiri' (Iclciilrd vcrsiof) ol "LitcKu v in the Cldssrooni" vvds presented fit the sum- 
nier V)72 rtMclinn conference entitled "Whtit Kids Oo in Kemlin^i" M the University 
ot Chit (i^o. With the«uith()r's permission, it is presented h(»re in a shortened, mltipted 
form l)e(«uis(» ot space < onstraints ot this volume. Unintentional changes in the 
author's meaning .ire the r(»sf)onsif)ilitv <>f the volume editor and the editor ot the 
NCR! Ikillelin Series 
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room. I will spcMk ol this ds "niakinK children literate on their 
materials," using the term lit(»rate to mean a satistactory level of 
romprehension [)erforn\an(e. Let us postpone cletininK "a satislao 
tory level of comprehension pt^rformanc e" until we deal with this 
crucial issue* in some detail lat(»r. First, let us examine some of the 
KtMieral aspects of literacy, as we will Lise that term. 

Nature of Literacy 

The term literacy has nearly as many meanings as it has people 
who use it. Some use it to refer to people who can both read and 
write; I will use it to refer only to people who can read. In reading, 
some use it to refer to people who can merely call the words that 
appear in print, while others use it to rt^fer only to people who Can 
both call the words and understand the content of printed mate- 
riaLs. Both definitions have their virtues, but for our purposes it 
makes sense to speak of a person as being literate only when he or 
she is able to comprehend the content of written materials. The 
schools teach reading skills not just to make the students capable 
of calling words, but to enable them to get content from the 
printed page. Our definition of literacy follows a similar logic. 
Literacy is not an al)solute or ideal .state— people normally mean 
something much more sensible when they use the term. Many find 
their reading skills adequate to serve all important needs and feel 
justified in labeling themselves literate. Almost none of us claims 
that we have achieved absolute literacy in the sense that we can 
perfectly comprehend every material printed in the mother tongue. 
The term literate, in the common sense, is specific to the task and 
to the person. A person may be literate or illiterate on specific 
readingtasks—illiterateon this editorial but literate on that receipt, 
for example. We apply the label "literate" to people only when 
they are literate on the reading tasks they want to perform and 
must perform as they go about the business of achieving their 
life goals. 

When teachers think of influencing students' literacy, they 
normally think of incro.isinfi thv students' rcddinfi skills. Materials 
prest?nt a number of linguistic problems: deciding what each word 
means, deciding how those meanings should be combined in each 
of the grammatical pattern*; used by the author, and so on. Teach- 
ers noimally see each of these problems as requiring some reading 
skill and set out to teach those skills. Editors or writers influence 
students' literacy by a/fer/n^j the readability of the materials. They 
assume n^aders know certain skills and select language that will 
present their information without requiring other linguistic skills. 
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UVi cin infliuMur studiMils' lit(»rtU V oil a riMdin^ selection in eiHiur 
t)t two ways: letU h them niori? ot thr skills required by thu selec- 
tion or alter the materials. 

l eac h(»rs typieaily i dnnot rewrite tc^xtbooks. lint they can assess 
till* riM(lal')ilitv of inatcMials and seliu t those most suitable tor their 
students, and tliey can i)r(»pari» a child lor a rivulinK assignment to 
reduce the ditficulty ot th(» material. 

A teacher's basic probli»m is to match mati»rials with students. 
Ideally, i»very material sold tor usi» in schools should tell how much 
skill is required to read that material with comprehension. Ideally, 
every tiMcher should have up-to-date test ores showing? the abil- 
ity of each studerit. With these measures, teachers could match 
studtMits' ability with the readaliility ot the material. Lackiny these 
convenicMices, teachers must take their own measures. One device 
is the rh)/.v rear/a/)///fy procec/t/re, an accurate and economical 
way to t(»sl students directly on the materials: we also have some 
valid and simple rviKLibility iormuLis for assessing materials. 

Problems with Traditional Direct Testing; 

I lu» time-honor(?d way to find out if a selection is suit.'ible for 
students is to test them on it. The teacher identifies some appro- 
priate content material writes some questions, has the students 
read the material and try to answer the quesvions, and then scores 
the tests. A criterion score (e.y., 75-90 percent correct), used to 
interpret thi» students' performances on the test, is supposed to 
represent a minimum level of desirable performance; the material 
is considered suitable tor those who score at or above the criterion 
score and unsuitable for those who fall below it. 

We want materials to teach content, so theoretically we should 
try out iiH materials to see how well they work. However, teachers 
do not employ direct testing widely and consistently or put much 
faith in it. Most have had strong; scientific, economic, and phil- 
osophical reservations about the procedure, which is impeded by 
problems that make it almost impractical. When teachers do use 
direct testing, they are na^j^ied by doubts about the results. First, 
procedures used to write the tests are likely to produce unreliable 
results. S(*cond, the criterion scores used to interpret the students' 
.scores are based on shaky rt^asonin^; and scanty evidence. Third, 
the tt»sts c\rv so difficult and expensive* to make that few teachers 
could regularly employ the procedure even ii they wanted to. 

Kvliahility. Irving? lor^v examined the scientific foundations of 
this procedure* and shook teachers' faith in it. In a classic paper 
on readability (1949), Lorye's argument went something like this: 
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Anyone who works with est writing knows that it is relatively 
informal. It is not a science that requires test writers to follow a set 
of rigid procedures specifying selection and phrasin ; of items. The 
test writer may exercise a great deal of freedom in choosing factual 
content, cognitive processes, and the phrasing of items; all the.se 
elements can have a decided effect on test difficulty. Test writers 
influence the difficulty of tests: two writers making a test over a 
single passage could produce tests of quite different difficulty, the 
one writer's test eliciting mostly low scores and the other's mostly 
high scores. Traditional test writing procedures do not give the test 
writer enough guidance to avoid this problem. 

Teachers often doubt the interpretation of test scores resulting 
from traditional procedures. Teachers cannot know whether stu- 
dents got high scores because the materials were very effective and 
taught the students a great deal or whether the test writer merely 
happened to feel generous that day and wrote an easy test. If the 
students made low scores, teachers cannot decide with confidence 
whether the materials were ineff-^ctive or the test writer produced 
a difficult test. Teachers know that the scores on traditionally 
made tests are influenced by the ability of the student, by the 
difficulty of the materials, and by the items that the test writer 
happened to write for the test. Teachers are justified in refusing to 
place much confidence in the results of traditional tests used to 
evaluate the suitability of instructional materials. 

Criterion Scores. The criterion scores used to interpret the results 
on traditional tests are those recommended by reading authorities 
(Betts 19 ;&; Bond and Tinker 1967; Harris 1962). These criterion 
scores differ, depending on the author, but there is some agree- 
ment that a student should be able to answer at least 75 percent of 
the questions on material for supervised instruction and at least 
90 percent of the questions on material for voluntary reading. 
None of the authors offers evidence or describes the reasoning for 
selecting these particular scores and no one else offers rational 
support for these criterion scores. 

Now, it is certain that each of the authors cited is among the 
foremost reading experts. Their intuition and common sense may 
be unexcelled. These criterion scores represent their considered 
judgments of what constitutes the most desirable performance 
level for students to reach on materials, The human mind is a 
marvelous instrument that enabled man to discover many things 
long before science, but it has also led men to believe that illness 
was caused by devils that had to be frightened, beaten, or bled 
out of a person and that thunder was caused by warring gods 
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hurling imc li c)lln»r about. Practia* based on common sense and 
intuition must be examined critically, and verified or refuted 
scientifically. 

As we hav(» discussed, students' scores not only reflect the 
knovvled^t* they obtained from the material (and therefore the 
effectiveness of that material for them) but also reflect the idio- 
syncrasies of the test writer. The si/e of a score does not provide 
a reliable estimate of how much of the material's content the 
student learned. Criterion scores on different tests made from the 
same material represent different amounts of knowledge and there- 
fore cannot be used to iudge the suitability of the material. 

Second, criterion scores are based on an assumption of the- 
morc'tfu'-hvtu^r or t/p-/s-^^ood. The criterion scores set a minimum 
level of performance but not a maximum level, thus implying that 
the better a student performs on a test, the more value he or she 
is getting from the material. This assumption might be valid if 
study influences only the amount of cognitive knowledge gained, 
but the learning situation thus suggested is too narrow to fit the 
facts: we also expect instruction to influence a student's interests 
and attitudes. We would not consider material suitable if it were 
so frustratingly difficult that students avoided it and use of the 
knowledge it contained, nor would we consider it suitable if 
students found it so simple, redundant, and boring that they 
avoided furthi?r study of it. Students dislike materials on which 
their comprehension test scores are either very high or very low 
and they show a definite preference for materials on which their 
te.st performance is at an intermediate level (Bormuth 1971). The 
criterion scores employed in the traditional procedure set only a 
minimum score; some of the students who exceed that criterion 
score on a material may be harmed by its study. 

The third reason for questioning these criterion scores is that 
their authors have not offered any evidence for or explained the 
reasoning that led them to identify these particular scores. We are 
left to wonder if the criterion scores sprang from an arbitrary 
decision that became standard practice simply because of the 
strength of precedence. The length of the English unit of measure, 
the foot, took on its value because the king wno standardized that 
measure happened to have a foot of that length. Tiie chief effect 
of this accident of hi.story was to saddle us with an amazingly 
inconvenient measurement system. 

We use these criterion scores because we believe they will 
produce more favorable consequences for learning. We believe 
students will receive more good things from materials if they score 
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between 75 and UK) [K»rrtMit on thi»m than it they score lower than 
75 percent. This may be so, but it is doubtful, since students' 
willingness to study materials falls off sharply when their scores 
fall toward the upper end of the 75-100 percent range. We do not 
know the conse^quences of relying on thi»st> critt^rion scores, which 
may interfere with and even subvert the intent of the instruction. 

Cost. The traditional procedure for evaluating materials has not 
received widespread use also because it is costly. The traditional 
test consumes a sizable amount of teacher time. To produce a 
test of reasonable quality, the writer must usually take a course 
in test construction. The traditional test is not an easy thing to 
write well; the author has found that it requires roughly 8-10 
minutes per item to prepare even fairly good questions using 
traditional test-making procedures. When these questions are tried 
out and edited to eliminate vague, ambiguous, and mistaken items, 
the time is at least doubled. To write a 25Htem test for a passage, 
a teacher would probably spend anywhere from 3 to 8 hours. 
More time is required to type, duplicate, administer, and score the 
test. Other duties compete for the teacher's time and resources 
and it should not be surprising that, because of the expense alone, 
these test-making techniques are not used routinely in more than 
a few schools. 

Traditional procedures for evaluating the readability of materials 
rely on inadequate and expensive tests and employ criterion scores 
of dubious quality. Nevertheless, some educators have used these 
procedures in the past and, I think, justifiably, for they were using 
the best and only techniques available. The materials chosen for 
instruction matter, because they differ in effectiveness and thus 
in the educational benefits students receive from them. Despite 
the difficulties of evaluating readability, we must improve our 
techniques wherever possible. And that is what the rest of this 
paper is about: describing a better way to test the difficulty of 
instructional materials and evaluate their suitability for students. 

Cloze Readability Procedure 

A major part of the problem with the traditional procedures 
arises from the kind of test they use. Those tests are expensive and 
difficult to make and they produce unreliable measures of the 
amount a student has learned from the material. We will now 
consider tests obtained by the cloze readability procedure, a pro- 
cedure that consists, roughly, of these steps: 

First, select one or more passages to represent the materials 
being evaluated. 
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Second, slartinK with the first word in the passage, count the 
words, marking every fifth one for deletion. 

Third, type a stencil of the passage but in place of every fifth 
word indicate a blank by inserting a 15-space underline. 

Fourth, run off copies of this test and administer it without time 
limits to students. Instruct the students to guess what word v\as 
removed to form each blank and to write the word in the blank. 

Fifth, score the responses correct only if they exactly match 
the words deleted. 

Finally, figure the percentage of items answered correctly by 
each student and compare it to the criterion scores that will be 
presented in a later section. 

We will begin by discussing the validity of this type of test and 
then describe each step in more detail indicating the research 
that supports it. A cloze test can be made, administered, and 
scored in a number of ways, and technically we will be speaking 
of just one type of cloze test, the doze readability test. We will 
examine this c/oze readability procedure in detail and refer to it 
for the rest of this paper using the terms doze, doze procedure, 
and cloze test. 

Validity. When we use cloze readability tests to measure the 
comprehension difficulties of passages, we assume that these tests 
measure thu mental processes called comprehension and that 
scores on cloze tests made from different passages measure their 
relative difficulties. The research is too extensive to detail here, 
but reviews have been written by Rankin (1965), Bormuth (1967), 
and Potter (1968). 

It seems clear that cloze tests do measure a person's ability to 
perform the comprehension processes. A cloze test provides stu- 
dents with a passage they have never seen before, but it is a copy 
of the passage with words systematically deleted. They must use 
the text that comes before and after each blank to arrive at their 
answer. Scholars such as johnson (1966), Miller (1962), and Good- 
man (1970) studied v^arious aspects of how people process lan- 
guage and consistently found that people use. the text they have 
just read to infer its meaning and structure and to guess the 
meaning structure of the text about to be read. People also use 
text just read to confirm their inferences about earlier segments 
of the text. These processes seem to be integral to the comprehen- 
sion processes, serving as an essential means of getting information 
from text as well as furnishing much of the information we get 
from it. The cloze test taps the comprehension processes at two 
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points by testing how nmch knowledge was obtained from the 
text surrounding the blank and how well the information obtained 
from the text was employed to obtain additional information. 
Research shows that we cannot distinguish the processes measured 
by traditional comprehension test questions from those measured 
by clo/e test items (Bormuth l%9a). These studies show that 

\>res on the two kinds of tests are so highly correlated that the 
processes that generate those scores are indistinguishable. 

The cloze test has important advantages over the traditional 
comprehension tests. It is made by a relatively simple and mechan- 
ical procedure. It is cheaper and easier to make and provides more 
reliable results. Studies on this subject typicr.lly show (Bormuth 
1962) that cloze tests of 50 items provide passage rankings with 
a reliability correlation of roughly .96, or about 92 percent reliable, 
while traditional comprehension tests have reliability correlations 
of about .34, or only about 71 percent reliable. Moreover, the 
difficulty rankings assigned to passages by cloze tests show very 
high correlations with other measures of passage difficulty, such 
as those obtained from oral reading word recognition scores, judg- 
ments of difficulty by readers, and ease of memorizing. While the 
correlations reported vary considerably depending on the reliabil- 
ities of the various tests used by the various investigators, these 
correlations are generally'about .90 when test unreliability is taken 
into account. The validity of the cloze test is firmly rooted in basic 
.psychological theory and in the empirical evidence obtained from 
the extensive research on the subject. 

Making a Cloze Readability Test. The rules that distinguish a cloze 
test from other tests are, first, that the units deleted are words 
(not letters, syllables, morphemes, or phrases) and, second, that 
the words deleted :i'v selected by some mechanical process that 
does not require th .«5t maker to employ ill-defined guidelines 
such as ''key words" or "important concepts." If teachers want 
their test results to mean anything, they must adhere exactly to the 
cloze reac/db/7/ty test rules which distinguish them from cloze tests 
in general. We know a great deal about how to interpret the cloze 
readability tests; any departure from these rules leaves the teacher 
with uninterpretable results. 

Selecting Passakes. Though occasionally an entire passage is used, 
usually we draw samples from the text and assume they give us an 
unbiased estimate of the difficulty of the entire text. Generally, a 
text will vary somewhat in difficulty from section to section. 
Drawing a single passage may give a biased estimate of the over-all 
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ullv ot tlu» iMitiri* t(»st, so it is useful to know iust how variable 
the text is. Up to a point, the more samples tested, the mori. 
acc urately variability c an be determined: any number of passages 
from 2 to 12 provide ^he information, but each additional passage 
beyoful 12 yields less c nd less information. As few as 1 to 3 pas- 
saKivs can be ack»c|uatt» to i»valuate a text for class use. Si»kx:tinK 
a page can be done by noting the total number of pages in the? 
text — i.e.. 150 pages^-and then randomly selecting a number be- 
tween 1-150 using a table of random numbers. 

Starting with the first paragraph, countdown the page 250 v^ords 
and go to tht> end of the sentence in which the 250th word appears 
to get the first sample passage. Carefully inspect the 250-word 
passage. Look first to svv that its comprc^hension does not depend 
heavily on the immediately pieceding text. If it does, move up one 
or more paragraphs until this is no longer true and then count 
250 words beginning with that paragraph. Dependence, here, 
mt^ans that the passage does not contain anaphoric words and 
phrases, such as this, it, numy, these words, or this criterion, whose 
referents are found only immediately preceding the selected part 
of the* text. In some books, everything that follcws the first chapter 
def)en(ls on that chapter, so we would select just the first 250 
words or so in the text. 

Second, the passage should not start in one major section of the 
text, say in one chapter, and finish in another. Again the solution 
is to move up paragraph by paragraph in the text until a suitable 
passage has been obtained. 

The text should not contain many mathematical symbols or, 
for that matter, many numerals. Some scholars studying the 
problems involved in using cloze tests on matlv »' ' M texts ; h 
promising ri»sults. But as yet we do not have f criterion 
scores for interpreting the results of such tests. 

A 250-word passage provides a 50-item test wn.. ; produces 
scores that are sufficiently reliable for most of a teac:her's purposes. 
Reliabilities fall close to .85; to increase the reliability by any 
appreciable amount, say to .90, usually requires a test about twice 
a.> long. Cloze tests based on passages 250 to .HOO words long 
happen to fit comfortably on one side of a standard sheet of paper 
and 50-ittun test scorers convert easily to percentage scores, by 
multiplying by 2. 

Deleting the Words. Randon^ly choose any one of the first five 
words in the passage and begin the deletions with that word 
(unless it is t»ssential ;o the meaning of the paragraph, in which 
case begin the deletions with, the fir.st inessential word). Mark 
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every titth word Ironi ihtil f)()inl until ^)() words are nuuked. A 
"word" is anything set ott l)y blank letter s|)ac(»s at either end. 
However, the [)art.s of hyphenated words are deleted as sef)arati? 
words when both parts of the eompoiind word can stand alone as 
separate wcuds. For e\amf)k\ svli-nhuh would Uv counted as two 
different words since both soli and n)a(ie Ciin stand alotu?, but 
c()-o/Jt?rcjfe would l)t? counti»d as a singlt» word sinci* the |)refix 
CO- cannot stand aloni». A number such as I5H4 is deleted as if it 
were a sinj»le word. Punctuation and hyf)hens art? never deleted, 
but apostrophes are deleti»d along with the word they appear in. 

The division to delete every fifth word is based on both scientif- 
ic and practical considerations. Leaving only one or two words 
between blanks in a clo/i? test reduces test efficiency. The answer 
to one item often depends uf)on whether the surrounding items 
were answered correctly. Each item measures the same thing that 
the surrounding items measure and yields little new information. 
MacGinitie ( 1%()) showed that this def)endency among items drops 
about as far as it can drof) when the distance between cloze blanks 
is increased to four words of text. Deleting every fifth word gets 
us close to thv maximum efficiency per item and permits using a 
short, economical |)assage that produces reliable test scores. 

Kv.pfiKlucing thv Tesf. Set the typewriter margins for ordinary 
manuscript typini; a IK'" left margin and a 1" right margin. Set 
the line ratchet for either a space and a half or two spaces between 
lines. Indent paragraphs and set other margins in the manner 
dictated by ordinary manuscript format. Type the passage onto a 
duplicating stencil. Omit each word marked for deletion and type 
a IS-space underline instead, leaving spaces before and after the 
blank just as you would for a word. Leave no space between a 
blank and hyphens or between a blank and punctuation that 
follows it. 

Underlined blanks must be of a standard length because varia- 
tions in the underlining affect the scores. Scores on cloze readabil- 
ity tests are meaningless to a teacher unless they can be compared 
with the criterion scores that will l)e presented later. These criter- 
ion scores were shown by rational procedures to represent the 
most desirable levels of performance on cicze tests of this sort. 
But these criterion scores were found for tests made only by the 
procedure being described here; if anything is done to a cloze 
test to make it either easier or harder than tests made by this 
standard procedure, then neither these criterion scores nor any 
others are valid for interpr(*ting scores on the test. If the blanks 
are varied to correspond to the length of the word, if the number of 
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underliru* strokt^s tt^lls how many letters are in the word, or if the 
response is cued by any means other than the standard underlined 
blank, then the test is invalid for evaluating readability. 

Fig. 1. Sample cloze test with instructions to students 

Instructions 

At the bottom of this page is a sample of a new kind of test. Each of 
these tests is nuule hy copying a few paragraphs from a hook. Every fifth 
word was left out of the paragraphs, and blank spaces were put where 
the words were taken out. 

Yuur job will be to ^t/ess what word was left out of each space and to 
write that word in that space. 

It will help you in taking the test if you remember these things: 

1. Write onV one word in each blank. 

2. Try to fill every blank. Don't 6e afraid to gues.s. 

3. You may skip hard blanks and come back to them when you have 
finished. 

4. Wrong spelling will not count against you if we can tell what word 
you meant. 

5. Most of the blanks can be answered with ordinary words but a 
few will be 

numbers like i427 or $72 or 1954 

contractions like can't or weren't 

abbreviations like Mrs. or U.S.A. 

parts of hyphenated words like self- in the word se/f-made 

Sample Test 

Below is a sample of one of these tests. Fill each blank with the word 
you ♦hink was taken out. You may check your paper when you finish it 
by looking at the answers which are written upside down at the bottom 
of the page. Write neatly. 

The Beaver 

Indians call beavers the "little men of the woods." But they 

really so very little. beavers grow to be or four feet 

long weigh from 30 to pounds. These "little men 

the woods" are busy of the time. That why 

we sometimes say, busy as a beaver." 

know how to build that can hold water. 

use their two front to do some of work. Cutting down 

a ■ ■ ■ ■ — with their four sharp-^^ ^ teeth is easy. A can 

cut down a four inches thick in 15 minutes. 

jnoqt? 61 ^i^n '91 'iAi>aq a 

SB 6 s! H jsouj 7 ^o 9 c, puc > tJi^Jqi T Z I.uojp i .sjaMsuy 
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Test Instructions. Test instructions worked out by the author 
iBormuth 1%4) are accepted as standard for administering these 
tests. The instructions are shown in figure 1. They are read to the 
students as the students read them silently. After students have 
several experiences with these tests, it is usually unnecessary to 
repeat instructions to them in subsequent testings. Warn students 
before they take their first cloze test that it will be harder than the 
other tests; this reduces the effect of students' anxieties on their 
scores. Formal time limits are not imposed on the tests. The stu- 
dents are encouraged to work as long as they think they can 
improve their scores, but some children work past the point where 
their efforts are productive. The tester can stop testing when 
that student's score appears to be a valid measure of his or her 
ability. Variations from these procedures reduce the validity of 
the test scores for evaluating readability. 

Selecting Students, When evaluating materials for use in ope class- 
room, administer the tests to all students to determine which 
students should or should not use the text. When evaluating 
materials for system-wide use, administer the tests to students who 
represent the full range of social, economic, and ethnic groups in 
the community. Dividing the school population into these cat- 
egories, randomly draw a sample of students from each category. 
Seek the aid of a research technician in designing this sampling 
procedure. 

Typically, children below grade four still struggle with the basic 
word recognition .kills and test scores not only reflect under- 
standing but also how well they are able to pronounce and rec- 
ognize words. Curriculum experts often think a text should be 
used primarily to exercise basic reading skills and only secondarily 
to provide subject matter information. To evaluate these texts, 
test the student's ability to recognize the words rather than ability 
to comprehend. 

Scoring the Test, A student's responses are scored correct only 
when they exactly match the words deleted. Minor spelling errors 
are scored correct so long as the response is otherwise correct. 
However, omission of plural or tense endings is scored incorrect, 
as in fdb/e for tables or v/ork for worked. Convert raw scores to 
percentage scores by multiplying the number correct by two, when 
a 50-item test is used, or by dividing the number correct by the 
total number of items in the test and multiplying by 100, for tests 
of other lengths. To save time, use a window key with holes cut 
in a sheet of paper so that everything but the responses is masked 
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when tlu* sUovt is [)Lu od over the test. Write the correct response 
beside each window. 

Some aryue that when a student writes in a synonym tor the 
deleted word this shows that he or she understood the passaj?e and 
therefore synonyms should he scored as correct. Their speculations 
are correct in asserting? that a synonym reflects comprehension. 
Scores based on synonyms show a fairly hij?h correlation with 
other measures of comprehension, such as scores on standardized 
tests of comprehension achievement and cloze test scores based 
on exactly matching responses. The chief problem is that scorers 
disagree on what is an acceptable synonym and, so far, it has been 
impossible to devise a set of rules for settling these disputes. 
Consequently, scoring synonyms correct detracts from the reli- 
ability of the scores. Studies repeatedly show that scoring syn- 
onyms correct adds a few points to everyone'^ score but does not 
increase the validity of the tests. When synonyms are scored 
correct, it takes from two to four times as long to score the tests, 
making the testing operation much more expensive. 

Scholars settled on the practice of scoring only the exactly 
matching responses correct. The criterion scores we will examine 
next are based only on tests scored in this manner. Test scores 
obt.iined in <?ny other way are invalid for use with those criterion 
scores, iwd therefore, for use in evaluating the readability of texts. 

Cloze Criterion Scores 

Suppose we have cloze test scores for several books we are 
considering for adoption. We must assign values to the scores 
saying how good or how valuable each score is. How should we 
assign values to scores on tests of this type? 

It is customary on standardized tests to assume that knowledge 
is good, that more knowledge is better, that children are in a race 
to get knowledge, that test scores reflect how well the children are 
runriing the race, and that the value of a score depends on how it 
compares with the scores of other students. These tests are accom- 
panied by percentile norms, standard score norms, and grade- 
placement norms which do not tell us either the quantity or 
usefulness of the knowledge to the student in performing tasks 
such as reading a newspaper or deciding which of two cans of 
beans represents the best buy. These norms merely tell us how far 
he or she is running ahead of or behind the pack. 

This method of assigning values to test scores is not the only 
way values can be assigned and it is not very useful for assigning 
.values to scores on cloze readability tests. A high score is not 
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always bettor than a Iowct score. The easiest passages produce the 
highest cloze scores and the highest comprehension test scores. 
Part of the reason students get high comprehension scores is that 
much ot the content of the passages was learned previously. A 
higher cloze score may not be a hotter cloze score when we 
consider only the information a person gains from a passage. 

Children do not like very difficult materials because they are 
frustrating and unpleasant to try to learn from. This would suggest 
that higher cloze scores are better, except that students also dislike 
materials that are very easy for them. Neither very high nor very 
low cloze readability scores are desirable, but which score between 
0 and 100 percent is the most desirable one? 

Ratiunale tor Se/ect/ng a Criterion Score. Selection of the most 
desirable scoro requires a definition of desirable. The value of a 
score depends on what that level of performance gets us and how 
much we value the things it gets for us. When we read a text, it is 
because we want to get something in return for our efforts: perhaps 
aesthetic enjoyment, perhaps information, or perhaps no more 
than a painless way to use up some portion of our lives. Here we 
are interested in: (1) how much information the average person 
gains from the text; (2) how willing he or she is to read it; (3) how 
novel the content is to the person; and (4) how rapidly he or she is 
able to read it. These four measures of the suitability of a text 
determine the value of each level of performance on that text. 
(See Bormuth 1971 for a complete account of the studies under- 
lying this reasoning.) 

Can we determine the value of our cloze score simply by finding 
how much of each of the four attributes we get when we obtain a 
score of a given size? Is the value of this score just the sum of 
these amounts? and is the best score the score at which this total 
is the greatest? Almost— but not quite. We cannot just add these 
things together without taking into account how much people 
value them. We must find the re/af/ve va/t/es that people place on 
each of the four outcomes of reading a text and add them to 
determine the cloze score with the greatest value. This will be 
our criterion score. 

Our conclusions are limited because people read for a variety 
of reasons and place different values on what they get from 
reading in various situations. No single criterion score can serve 
all purposes; a score serves only the purposes for which it was 
designed and is useful to people who share similar values. Al- 
though not all people value information gain and the other benefits 
of reading in the same way, people fortunately are remarkably 
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Fig. 2. Information gain measured by performance on completion 
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similar, and the critorior) stores to he given here represent the 
consensus of the vast majority of the teachers involved in these 
studies. 

To determine criterion scores for cloze readability tests then, 
we need to find the relationships b(»t\veen clo/e scores and what 
we want to get from reading. The four outcomes mentioned earlier 
were studied: information gain, a student's willingness to study a 
material novelty of the material's content, and rate of reading. 

Information Cain, Information gain was measured using several 
passages that were nearly identical in difficulty. A traditional 
comprehension test was made for each passage. Students were 
first given one of the tests and told to guess as many of the 
answers as they could; they were not given the passages on which 
the tests were based. The purpose was to find out how much 
students already knew about passages at that level of difficulty. 
Each student was then given a passage of matched difficulty to 
r'Md and took the comprehension test made for it. Each student's 
score on the guessing test was subtracted from his or her score on 
the actual comprehension test to obtain a residual gain score. 
Finally, students took a cloze test over a third passage that was 
matched for difficulty with the other two passages. The passages 
and tests were switched for each student to assure that peculiar- 
ities of a particular passage could not bias the results. Eight sets 
of passages were used so that eight difficulty levels and a variety 
of subject matters were represented. A total of 1600 students were 
tested, 160 at each of the grade levels 3 through 12. 

Figure 2 shows a graph of the results of th^ ;nformation gain 
tests. These lines show the average amount of information the 
students gained at each level of c\oie performance. The horizon- 
tal scale shows the students' cloze scores and the vertical scale 
shows the amount of information gain. Each line shows the results 
for students in a different grade level. Students who made cloze 
scores as low as 0 to about 35 percent gained little or no informa- 
tion from the passages. These students had much difficulty under- 
standing the passages. Thereafter, students who made increasing!,' 
higher scores made increasing gains in information. But this rise 
halts when we reach students who got cloze scores of about 80 
percent. After that point there is a sharp drop-off in the amount of 
information students were able to gain. A cloze criterion score 
based on information gained from a passage would be set at 80 
percent, the point where students receive the most of this value- 
information— from their efforts. 
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However, the fiuuter is not that simple. When the data are 
analyzed for students at each jjrade level separately, the curves 
are parallel but different, as fifiure 2 shows. The graphs of the 
other tests also show that the curves are different for each ^rade 
level. This tells us that we must use different criterion scores for 
students at each ^rade level. 

Willinfinvss to Study. Cloze scores were measured on one passage 
and willinKness to study on a passage of matched difficulty. 
Willingness to study was measured using a seven-point scale with 
7 described as "like very much" and 1 described as "dislike very 
much." The student read the passage and rated it on this scale. 
Figure 3 shows the results. Students rejected both very difficult 
and very easy study materials. They preferred passages on which 
their scorers fell into an intermediate range of difficulty. Their 
preferences reached a peak well below a cloze score of 80 percent 
where information gain is at a maximum. Students were also asked 
to rate the passage for use as a textbook, a reference book, and 
as voluntary reading. These curves were similar in overall shape, 
but peak cloze scores differed. We must use different criterion 
scores for students at each grade level as well as for each major 
use to which a text is put. 

Difficulty. Students also rated these passages on a difficulty pref- 
erence scale which seemed to measure how new or novel the 
content of the passage was to them. One end of this scale was 
described as "not suitable" and the other end as "suitable." Figure 
4 shows this curve when the students were rating the passage as a 
textbook; 2.0 represents "not suitable" and 4.0 represents "suit- 
able." The curves for reference reading and voluntary reading 
roughly paralleled this one but differed at the peak points. 

Rate of Reading. Students were timed as they read the passage on 
which they took their comprehension test and these times were 
converted to words-per-minute scores. Figure 5 shows the results 
when this curve is plotted. 

Weightinfi the Reading Outcomes, Teachers furnished judgments 
on the relative value of each of the four outcomes. Given a 
description of each outcome and a 10-point scale, teachers chose 
the least valued outcome and assigned it a "1" rating, assigned the 
most valued outcome a "10" rating, and placed the remaining 
outcomes at points that seemed most appropriate to them. A total 
of 101 teachers, drawn in about equal numbers from each grade 
level made the ratings. The grade level at which a teacher worked 
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htui no sifiniiK .inl oWvi i on lhi» ititinHs, l)ut tln» usi» to bv mado ot 
thv rncitiM'iiils had ti unwi i^ltoc t. "Inforfntition Htiiii" eai'iu^cl a m(Mn 
rating ot 3.S wln»n tearht»rs wimi» rating its im()()rtiuic e tor ti^xthook 
ri\Klinn. but earned only 2.7 vvht»n thoy rated it for vokintary 
reading. 

Findiiiii thv (>/rcr/on Secures. I he last step eonsists ol usinH the 
outeome rtitinns to c alc uLite the Viilue ol etu h c lo/e sc ore tUid 
then identifying the most valued score tis the c riterion score. All 
the sctjies were convcTtiHl to standard scores so thc»y would he 
expressed in roughly ick^ntical counting system.s. The information 
Hiiin thtit correlati»d with i\ c lo/e scorf* of one* pt^rccMit was iden- 
tified and nuiltiplii»d l)y its rt»tinn for thtit type* of reading task 
ltc*\tl)0()k, ri»fi»rtMK i\ or voluntiiry); this weijihted sum indicatcvs 
the infornitUion ^ain of rUuv score of one percent. The* values 
that this same clozi* score c^httiins irom cnir other measures of 
suitability- willinnness to study, difficulty, and rate of reading — 
were* caU ulati»cl in the same* way. These finjr values were then 
added toni»ther to obtain the total value of a clo/e .score of 
ont» perci^nt. 

This proct>ss Wt»s ri»pivUi»d for ti cloze scon* of two percent, 
thrt»e pi»rnMit, and so on until the total valut^of all cloze scores 
had bei»n found. The score ri^ceivin^ the f>reiitest tcjtal value was 
taki»n as thi> critt>rion scortv Thirty criterion scores were estab- 
lished, one tor each of the three uses ot the material within each 
of ten Hrade levels (s(>e table 1). I hi»sitated lo include the results 
for uracil* thrive btrausi* I have rathiM' strong reserVtitions about 
wht^ther tht» mati»rials at that HrtKk* U»vel should be evaluated this 
way. However, they are iocluded alon^ with the admonition that, 
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tor t:hil(lr(?n Inflow yr^nli' tour, it is prohiihly iis itnportant, or oven 
more important, to uvdludto the word recoKnition clittic ulty ot the 
mdteridls as it is to evaluate their comprehensibility. 

These criterion scores are far superior to any other criterion 
scores available. Tliosi* previously otlerinl \nw s(*lectt»(l tor un- 
kiiown reasons and had unknown consequences; the ones shown 
in table 1 are based on a logical modiH that explicitly incorporates 
our social values and combines th(?m with scientific evidence. As 
the results of the first effort to establish rational criterion scores, 
they are only approximations of the criterion scores we will ev(?n- 
tualiy identify, although future research will probably alter them 
only slifihtly. We cannot acce[)t any criterion score unless we can 
accept the reasoning and evidence on which it is based. Only the 
barest sketches of reasoning and evidence have been yiven here, 
i^id I strongly recommend that users of these criterion scores 
study the original research report (Bormuth 1971) carefully and 
critically to assure themselves. 

EViilUiUin}* C/oze Kvaddbility Scure.s. How do we determine if 
material is suitable for a student and how do we determine if it 
is suitable for a group of students^ 

With a single studi>nt who has taken one clo/e test over each 
of several sets of materials, we set the highest value on the 
material on which his or her test score most cloiely approaches the 
criterion score and corre^^pondingly lower values on the other 
materials tested. Presumably, we have also examined and eval- 
uated the contents of these materials for quality on some scale. 
The material chosen should best represent a compromise between 



content and readability. Readability and content values hav^^^' 
Ipvver limits of acceptability. In readability, we might place this 
lower limit at a cloze score of 3S percent. Figure 1 shows that 
students scoring below 35 percent exhibit less than a five percent 
information gain. Hence we might say tliat materials falling below 
that level are essentially worthless for teaching that student and 
probably should not even be consioered in the final selection. 

With several tests ovei a t?xt eliciting two or more scores, we 
can estimate roughly how variable its readability is. Some variabil- 
ity is unavoidable and possibly desirable for breaking monotony. 
Too much variability almo.st assures that part of the material will 
be poorly learned by the students and the teacher will have to 
rind the difficult spots and supplement the text witli explanations. 
A text of even readability is preferable over a text of quite variable 
difficulty. 
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UIimIIv, 111 s(»K'( lin^ tt^xts lor i\ Lum* lUinilnM ot stucliMUs who 
Vtiry in iiMclinK iihilily, vvi» would not chooso o sinnk» [v\{ bt^caust? 
Hi'iMt (litti»riMii'i»s aniony inclividudls indki^ cUiy [v\[ poorly 

siiitiul to i! larK^' nupiher ot students. Hut li^xts diiivr in contimt and 
ornani/tilion and tiMcluMS lack [\w tinu» to vary instruction accord- 
ingly. It is ottiMi lUH isstiry to iMn|)lo\ oiu* text with studiMits who 
hiWv a widi» vari(»tv ot iibilitit^s, lo si^kut such a ti^xt, choc^so 
nuitiM'iiil on wliicli thi» nuMn c lo/o scon* tails sonn^what abc^ve tho 
crittM'ion s( ortv tissurin^ tliiit tliu niatt»rial is |)artially coniprehen- 
sibk» to'ncarlv cvi^yontv Sonu* of the able stutkmts will find this 
text insi|)id iind rc|)(*titioiis of pri^vious material. Ikit tlioso stu- 
dents can usually work iruk^piMidiMitly, rt^idinK niore advanced 
referi»nci»s and doin^ other projects. An t^asy text helps the slower 
studtMils t»xtract tin* biisic content, relieving the teaclier of the 
obligation to repiMt tin* conttMit throu^li 'ectures. It also |)rovides 
slower studiMits with |)ractic e to i»xtend their reading skills. 

loriiuilas for Predii tiny Readability 

If wi» want to know how well our students will d' on a material, 
We mei(»l\ iUH»d to make ii si»t of clo/e readability tests to find out. 
\\m' ( lo/e rc»adabiliiy [Kocedure is direct and it is buttressed by 
reseau h that is possibly the most thoroughly validated and sophis- 
tic tiled method of tivUinj* |)ri»simtly used in (jducation. However, 
ihouuli ( luMper tlian tin* |)roci»durt»s it re[)laces, it is still expensive. 
(I st\ll retjuires a lot of work to make, administer, scoro, i\n(\ inter- 
nr<»f thest* ti^sts-oftt^n. mort* work than the t(*achor c an justifiably 
(k»vole. C()ns(»qut?ntlv, tlu» teaclier ni»eds an even less expensive 
way to determine the diffic ulty of materials. The rc»adability for- 
mula is sucli a dc^viccv 

Si ii»ntists studying tlic» sources of difficulty found that difficulty 
is rc^Ktilated by thi^ lanKuaKc* of a passajio, They published formulas 
that pc^rmit ti^achc^rs to |)redi( t tlie diffic ulty of materials 
by UiMSurin^ c:out)le of filatures of tin* lanyuaHe in the* matc»rials, 
insc^rtin^ thc»sc» numbers into the* formula, and then working} out 
the* formula. These formulas have? steadily improved in accuracy 
and in the* ease with whic h t(»achers can use them; we will present 
i)\}v of the most accurate* and simple. 

DcriVtition of thi' rnnvuLi A comi^k^te descriptU)n of tlu» nu»thod 
and tlu» data on whic h llu» formula is loast»d can be found in 
Bormuth (1%9b). The [Hissa^i^s selected should be representative 
of th(» kind of passages we vvan^ to evaluate. From instructional 
mat(»rials, i.U) i^assagc^s were* sc»k»ct(»d following much the same* 
ruk»s given whtwi we discussed making ( nr/.v tc^sts, except that no 
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two ot tlu»se |)ass,if»(»s ( iiinc trofn iIh» s.uin> toxt. VW chose M 
|).issag(»s frofii tvu h ot It) sLil)jcH t fiiattc»r aruas with materials from 
grade one through college. 

Clo/e (liftieulties were ch^terniifnul aiul converted to grade- 
placement scores, using clo/e readability tests made from each 
passage. Ihese wimi^ adniinist(»red to groups ot Jfr) students trom 
grade 4 through grade 12: each grade level was ri»prc?*^enti»d about 
evenly in a group. No single child took JM) tests, but 50 carefully 
matched groups ot tc»sts wvrv. us(hI. 

\ i.iojs features of the language in the passages were analyzed 
and neasured. Feature's usi»d to predict readability range from 
counts of the average numl)er of letters in the words or sentences 
in a passage to counts of the average number of syntactic trans- 
formations rtH|uire(l to go from the surface structure of a sentence 
to its deep structure kernels. The* variables included in a readability 
formula reflect how simple or foolproof we want that formula to 
be. It is possible to olnain a very accurate formula with a validity 
as high as /Ji; it is nearly impossible for even a clever writer to 
fool such a formula by making a passage appear easy when, in 
fact, it is difficult, liut to use such a formula we must pay a price. 
The price is the cost of applying the formula, for very foolproof 
and accurate formulas include a large number of variables that 
are often complex and time-consuming to analyze. How(»ver, we 
can use a simpler formula if we sacrifice a small amount of 
accuracy and assume the* writer did not try to make the pasfiage 
appear easier than it really is. 

The two varial)les selt*cted, word length and sentence length, 
are easy to analyze without getting involved in word lists or 
complex grammar analyses. We chose to measure length in terms 
of the number of letters a word or sentence contains, avoiding 
decisions about h(jw many syllables a word contains. These two 
variables proved to be as accurate as any other variables used so 
far to prtKlict readability. 

Calculating the formula involved a mathematical procedure 
called polynomial multiple-regression analysis, but the result is a 
fairly simple equation that we all learned to solve' in fi»*st- 
year algebra: 



w \ s 



.(J0()(J()2 



This is the f)tisi( readability equation that we will use. However, 
tal)le 2 is providful to (eliminate tin* need to solve either this 
equation or its modified form. What this equation says is: The 
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(1iHi('ult\\ (/. ot i\ t)iiss<i^i» in t(»rms a\ c\o/v nuwns is oqual to 
IA)M niiiuis lOh linu's tli(» dvi^raHt' nunil)tM' o\ \vUvrs \w word in 
tho tHisscigi\ tincl so on. Thi> syinool l/s slcinds lor letters 
|)er s(Mit(Mu e, 

This bcisii forniuld (\m l)e ustul to obtain modifi(»d formulas that 
e\t)ri\ss passage* dittit ultv in terms ot grade [ilaetMnent scores: 
thv ^rMh pLn.omvnt scorv a stiuhnt would /ia\'e to ^vt on a cvrtdin 
stdiuLirdi/iHl achivvomvnt tost in o/c/er fo reach a criterion score 
on thiit nh\trrii}i This grout) formulas has a validity of about .81, 
Two-thirds of the time a t)cissage of about 100 words predicts a 
student's clo/e score to within about 6 cloze percentage points, or 
about ,8 of a vi»ar in grade plac(>ment terms. Two t)assages drawn 
from the same tiiaterial increase the validity to about .89 and 
fivi» such t)»tssages incr(»ase validity to about ,94, 

Applyinfi the FinmuL}. Table 2 was prepared to avoid the need for 
calc ulation using the formula. The top third of table 2 is consulted 
wiuMi teachers want to use 35 fDercent on a clo/e test as their 
criterion score, the middle third consulted for a criterion score of 
4^ percent, and the bottom third for 55 f^ercent. Each number in 

^thi» body of this tal>le stands for a grade placement score on a 
standardized test of reading achievement; the number 6,.J in the 
up|)er k»ft hand corner, for example, stands for the third month of 
the sixth grade. The nutnbers down the left hand column of the 
table stand for thi» avt^Tagt^ number of letters in the words of a 
passage and the numbers across the top of the table stand for the 
average number of letters in the? sentences, 

I he readability of d t)assage can be determined by calculating 
the average number of letters (:ontainc?d in the words and sen- 
tenci»s of the passage. Choose a passage in the text you are 
considering according to the rules given when we discussed how to 
make a cloze readability test. Count (1) the number of letters 
in the t)assage, (2) the number of words, and {^) the number of 
sentences. Divide thi» number of letters by the number of words to 
determine the average number of letters per word in your passage. 
In table 2. in the section labeled with the criterion score youVe 
derided t(> use. find the "letters per word'' (left-hand column) 
clos(»st to the average letters \yer word of your t^tissage. Then 

divide^ th(» number of letters by the number of sentenc(\s to 
df^termine the average^ number of letters per sentence and find 
the numl)er closest to your average in the ''letters per sentence" 
htMciing at the tot) f)f the table. The number at the intersection of 
your "letters t)er word" row and "letters t)er sentence" column is 
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\y()iil__ /J (1^ Jih H)^ I U) I )J /:•/ l')h 2 in J40 

C*ritt»riiin Si ow = T)",. 

W (). < b.» 7/) ».() ».() H.» H.() MM 7/) 7/) 

W) ().() 7.1 7 H \ H.7 I I H.^) H.() H. < 7.H 

() ^) 7/") ».:? H.H I 9.4 9.4 9. ^ 9.1 H.7 H. I 

4/ 7.2 7.H H.l "9.1 9.4 9.7 9.7 9.7 9.4 9.1 H.^ 

4.4 7.^) H.J H.9 9.^) 9.7 ID.O lO.O lO.O 9.7 9.4 H.H 

4() 7.H 1^") 9. J 97 ID. I) \[).\ 10. 5 lO. i lO.O 9.7 9.J 

4. « L_ H.I H.9 9.^) ID. I \[)..\ ll).(, ll).() l().(» \[)..\ ID.D 9/) 

5. / H.4 9.2 9.H ID. < 10. (» 10.9 •|l).9 10.9 V).h 10. < 9.H 
.1.^ H.H 9.(1 lO.J |().(, 10.9 11.2 \\.\ 11.1 10.9 K).() lO I 

9. J 9.V 10.-, 10.9 11.2 11.^ I 1.1 II. ^ 11.2 ID.H 1D.4 

9.'-, |().> lO.H 11.1 II. S 11.(, ll.h 11.1 11.4 11.1 10.7 



Ciritcrion S( — 41' u 

i.4 7H H4 9.0 9.5 9.7 9.H 9.9 9.H 9.() 9.2 H.H 

i.h \ H.I .17 <).2 9.() 10.1) 10.1 10.2 10.1 9.9 9..1 9.1 

r9 H.5 9.0 9.1 9.9 10.5 10.4 10.1 10.4 10.2 9.H 9.4 

4 / H.() ).2 9.7 10.2 1D.() ID.7 10. H 10.7 10.1 10.1 9.7 

4. -4 iu) }).:> uw nia 10.9 ri.o 11.1 it,a 10.4 10.0 

4h 9.1 9.7 10.5 lO.H 11.2 II. :5 11.4 11.5 11.1 10.7 10.5 

9.5 10.0 10.() 11.1 11.-) 11. () 11.7 11.0 11.4 11.0 lO.b 

.1/ 9.h 10.5 10.9 11.4 11. H 11.9 12.0 11.9 11.7 11.5 10.9 

.1. { 9.9 11.2 11.7 12.1 12.2 12. 5 12.2 12.0 11.1) 11.2 

5. (> 10.1 10.9 11.1 12.0 12.4 12.1 12.7 12.^) 12.:5 11.9 11.1 

10.4 11.2 II. H 12.^ 12. H 12. H 15.0 12. H. 12. 7 12,2 11. H 



Criterion Stow = 11?.. ^ 

j 4 9.5 9.H 10.2 1().() 10.H 10.9 11.0 10.9 10.H 10.1 10.1 
if) 9.1 10.0 10.4 10.H 11.1 11.2 11.5 11.2 11.0 10. H 10.4 
{9 9.7 10.2 10.7 11.1 11.4 MSy 11.1) 11..^) 11. .5 11.0 1().() 
4./ 9.9 10.4 10.9 11.5 117 11.H 11.9 1I.M 11.() 11.5 10.9 
4 4 10. 1 10.7 11.2 11.() 12.0 12.1 12.2 12.1 11.H 11.S 11.1 
4.6 10.5 10.9 11.4 11. H 12.5 12.4 12.1 12.4 12.1 11. H 11.4 
4.H 10 1 11,2 11.7 12.1 I2.() 12.7 12. M 12.7 12.4 12.1 11.(» 
5/ 10.H 11.4 11.9 12.4 12.9 I'^.O 15.1 15.0 12.7 12.4 11.9 
li III 11.7 12.5 12.7 152 15.5 15.4 1.5.5 15.0 12.7 12.2 
W> 11.5 11.9 12. f) 15.0 1V1 1.5. f, 15.r...l:5.7 15} 15.0 12.^ 
fiH 1l.() 12.5 12.9 15.5 I 5.H 14 0 14.0 14.0 I 5.7 15. 5 12. H 
.11-- - . ^ 
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the rtMcliihility ol your passiW expressed in a grade placement 
score. Repeat this ()rocess on as many passages from the text as 
necessary to get the accuracy you want and can afford to take 
the time to get. 

Now let's go through this procedure again using the first par- 
agraph from this paper as our example. Following the rules dis- 
cussed earlier, imagine that we have drawri a sample that happens 
to coincide with a paragraph (in actual practice, we can ignore 
paragraph boundaries). Let's say that we want to know how much 
reading ability is required to perform on this passage at both the 35 
percent and the 55 percent criterion levels on a cloze text. 

By counting we find that there are 622 letters, 120 words, and 5 
sentences in the sample paragraph. When we divide the 622 
letters by the 120 words, we find that the average length of a word 
is 5.18 letters, so we mark the 5.1 rows in table 2 for the two 
criterion scores we are interested in. 

Whefi we divide the 622 letters by the 5 sentences, we find that 
the average sentence length is about 124 letters, so we mark the 
column headed 130, the closest column to this average sentence 
length. When we go down this column in the 35 percent criterion 
section to find where it intersects our word length row, we find 
the number 10.9. When we do the same for the 55 percent criter- 
ion, we find 13.0. For greater accuracy, we might want to repeat 
this process for several other passa^as from the paper. 

\JsingtWis table rather than the formula reduces the amount of 
calculation required. The major source of labor, counting letters, 
can be reduced further by estimating, since adding or subtracting 
a few letters would not change the results. To estimate, count the 
number of letters in each line in the first two sample passages to 
be analyzed; omit partial lines and indented lines. Add these 
counts and divide by the number of lines to get an estimate of the 
average number of letters per line. On succeeding passages, es- 
timate the number of letters by first counting the number of full 
lines and multiplying by the average number of letters per line, 
and then adding to this the number of letters actually counted on 
the partial lines. 

Interprvtitifi the Results. If a teacher took the results at face value, 
he or she would go to the test records for the class and look up 
each student's score on a recent rep'^ing achievement test. The 
teacher would not give this paper to any student with a score of 
less than 10.9 on the reading achievement test. Table 2 shows that 
those students are likely to gain little or none of the information 
the paper contains. 
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SirniliiHv. stiuhwUs with scones l)(>tvviH»n 10.9 and ^^X) shou'd bo 
introduced to the [)a[)er helori* they are required to read it. The 
teacher should so through the paper carefully, notiny the vocab- 
ulary items that will cause difficulty and making an outline of the 
main ideas. The teacher should teach these concepts, discuss the 
major points of the paper, tind possibly ev(>n [)resi>nt the students 
with questions to be answered when they finish. Although most 
students would benefit from this kind of introduction, it is essen- 
tial for students at these reading levels. Students with reading 
achievement scores at or above 13.0 can probably read well 
enough to get most of the content without help. 

When several months have passed since a student took the 
standardized reading achievement test, the score will underes- 
timate his or her present ability level. To correct for this quickly, 
determine how many school months have passed since the student 
took the test, count each month as .1 of a year, and add this 
amount to the score. A more accurate procedure consists of sub- 
tracting one year from the student's grade placement score on the 
test and dividing this number by the number of years and months 
spent in school up to the time the test wa^^given (months in school 
are scored as .1 of a year). This number estimates the rate of past 
learning of reading skills in skill years per school year. Multiply 
this rate by the number of years and months of school up to the 
present time; then add one year to arrive at the student's estimated 
present grade pVaceine^m snore. \One year is subtvacled fiom a 
student's grade number to get the number of years in school, 
assuming that the student was neither retained nor accelerated.) 
This estimate of the student's present score can be compared with 
the passage readability score. The teacher should be alert that a 
few students will always show scores somewhat higher or lower 
than their true ability warrants. 

The reliability of the formula can be increased by analyzing 
more than one sample passage. As the number of samples from a 
text reaches six, however, the reliability and validity of the 
estimate rise extremely high (both in excess of .94). Little can be 
gained by analyzing more passages, 

The teacher should carefully note variations in readability from 
one sample passage to another. Most variations will lie in a range 
of about one year. When they spread out more, select a more 
uniform text or locate the difficult spots and give the -students 
special preparations before assigning thc^se sections. 

The original study on which this formula is based indicates that 
grade placement numbers derived from scores from the Cdlifornia 
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/cs/. TM)^ nouns, ww intldtcHl pKuiMiuMit scores 

c'()ni|)»iriHl l() scorers tioin otluM* t(»sts. \Uv intldtion cUiiouiits to 
.l)()Ut onv viMr, It d school ust»s thi» Calitinnid Ri\ulin^ Ttvsf, 
1%.^ norms, th(» r(M(Kihilit\' scores in tdhli* 2 cu curiitrly pri^lict d 
sludcMit's iMMtorniiincc* on d t(»\t. lUit it d school usvs cUiOther ti^st, 
sul)irtiil tihout i\ \Vi\\ IroMi tUv |)dssti^o rcMcKihility score* dc^tiM- 
niiniul hy tdhlc* 2. ^\^v Llnitiul Stdtc^s Otticc ot Ltlucdtion is con- 
ducting tin i»Lihorc!t(» study to coni|)drt» thi* norms ot dll Ihr nidjor 
rcMclin^ t!chicA'iMiHMit t(»sts; whcMi it is com|)l(»t(\ thosi* f)assaK^* 
r(M(lcil)ility scores should bv \rvv\\ c:onvertihlu to any test. 

Summation 

Writti^n materic!ls tire oni» ot our most im[)ortant instructional 
dc^viccs. H students Ctin uncliMstand thcMii, tlu^y relieve* the* teaclier 
ot th(» hil)()rious and tinu^-consumin^i task ot dcdiverin^; cont(»nt 
though l(H'tur(»s. This trees the* tiMchi»r to sf)c^nd time directing* 
th(» students in discussions and other activities that h(»lp them 
evakhiti* their knowledge, apply it to problcMiis of cuirent interest, 
and even learn how new knowledge is deveh^pcxl. It the instruc- 
tional nititi^ritils arc* incoiiif)relnMisihU\ the ti\'ichc»r's main concern 
ht»comes one ot staving oft »icademic disaster. This means lon^ 
houiss[)ent [)re[)arin^ and d(»liv(»rin^ lecturers and exf)lanati()ns of 
the* htjsic cont(Mit. I hO teacher C cinnot le^ul lively discussions and 
[)r()jc»cts on content thtit tin* students liave not yet learned, and 
knowled^ic* ot basic c ontcuit is norm<dly considered thi» minimum 
esscuititil of c»ducation. l^ar^c* amounts of educational funds liavc* 
hc»en Wtistc^d on nititc^ritils that could not f)(M'form thcnr roUv We 
fiuist c!ssurc» that students litc^ratc* on the maU^rials they must 
studv. 

One* approac h is to tcMch thc> studcMits as many rc»adin^ skills as 
ma\' \)v rc»c|uircHl hy thcMr instructional materials, llic* scrond 
ti[)[)rc)ac h is the* conc cMn of this [)ti[)er to alter thc> matc^rials so 
thtit thc»y more* closely nititc h tin* rcMdir)^ skills of the* studcMits. 
TcMc hc»rs cannot hc» e\[)CH ttul tof rcAvritc* materials, hut tlic^y c <in 
sc»lcH t nititcMials. This \h\\wr desc rihes two mc»thods for c^valuaMri^ 
the* diffic ulty ot matcMitils, The first nu^tliod consists of niakint; 
c lo/c» readability tc»sts over nititc^ri^ls and tc^stin^ tlu* studc^nt on 
them clircH tly. I he scuond consists of af)[ilyin^ a rcMclability for- 
mula to the* materials. I he* c lo/c» rcMclability tc^stin^ f)roc (Hlurc» is 
more* dircH t, but considerable amounts of teacner cjnd student 
time* arc; rc»(|uircHL c»vcmi though it is more* economical tlian earlier 
mc»tliods of assi»ssint{ tc»xts dir(?ctly. 
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A ri?iuliil)ilitv loiimilii, ow llu» other hand, has problems that the 
cloze reaclal)ilitv testing proce ' wro does not, althounh it can 
predict cloze read€il)ilitv scores with sutticient precision tor teach- 
ers more economically than can cloze readability testing. However, 
the tormula is f)r(H ise otily undc»r ci»rttiin co.nditions: when the 
students recently took a sttuulardized reading test, when that test 
was the same one used to derive the r(»adal)ility tormula, and when 
the teacher has cuuil ./ed several sam[)les from the text. These 
conditions are hard to match exactly, but teachers can compensate 
tor them as we discussed. In any case, teachers have here two 
devices tor increasing the ettectiveness ot the materials chosen 
tor their students. 
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5 Diagnostic Procedures 

Auditory Discrimination: 
Differences versus Deficits 



The recent past witnessed an increased interest in the learning 
processes of the so-called disadvantaged child. This interest re- 
sulted from the discovery that vast discrepatu i^s existed between 
the academic achievement ot what the literature calls "lower class" 
children, especially "lower class" black children, and the achieve- 
ment of middle and upper class youngsters. To investigate this lag, 
researchers de>sc(>n(led upon the communities of the "deprived." 
Their goal was to explain the lag and to construct improved models 
for educating "deprived" youngsters. Their task was to describe and 
to prescribe. 

The descriptions resulting from these iaveMi^aUons became 
enormously important in the subsequent development of educa- 
tional programs for "lower class" children. When a black child was 
described as "culturally deprived/' there was an assumption that 
he or she had no language, no customs, no social institutions, no 
behavior patterns, and no expectations for the future. The resulting 
educational pDgr.im sought to fill this cultural void through in- 
culcation of the language, the customs, and the behavior patterns 
of the dominant culture. On the other hand, if a black youngster 
is described as "culturally different," the assumption is that he or 
she has a language, customs, social institutions, behavior patterns, 
and expectations which are shared with other members of the 
• cultural group; a very different kind of educational program evolves 
from the need to pref)are yc^ungsters to function in a society which 
acknowledges and respects the contributions of aP of its citizens. 

If there are to be viable programs for educating the less .fortunate 
members of this society, the importance of accurate descriptions 
ot their learning difficulties cannot be underestimated. Differences 
must be clearly distmguished from deficits 

The development and standardization of th^ Wepman Auditory 
Disrjimination Tvst or WADT (Wepman 1958), along with Wep- 
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tUim's liiuliu).;s wliu li iiulic d siynif ii ciiU rincilii)iishi|) hi^twiu^i 
|Hu)r cirtic uliition liucl cUiclitoiy disc liniindtion cWid In^twcuMi tui- 
clitorv disc riniihiition liiicl rtMclinH cu hit'VCMiHMit ( P)()0), stitiuildtc^d 
ii ^nwi ol iiitcM'c^st ill tin* cUiditory cliscTiiiiiiiatioii C iipiU ity of 
"loucr c ldss' hLu k V()iniu*^tcMs wlio hiul Ixhmi ck^sc rihc^d by lul- 
lU iitors lis iniirtic ulcitc noii-ictick^rs. 

llic is iin indivickuilly culniinistiMcul lc»st whic ii consists 

of r'ortv wc^rd [idirs. ihirtcH U word j)inrs diiivr in inititil consonant 
lihonrnnv thirliHMi cliHt»r in lintil consoiiiUit |)honenH\- tour ditl^cM 
ill nicdiiil vosvi*! phoncMin*; tincl tc»n tire* tin* scinuv Tin* youngster's 
tiisk is to listcMi lis tin* word |)airs arc* rc*ad hv tin* c*\tiniint*r ami to 
indicate* wlu*tln*r the |).!irs arc* thi* "sanu*" or "clitferent" 
(VVc*|Miian 

1 he* |vc*sc*nt iiniuiry Wiis ins|)iri*(l by thi* author's c'\peric*nct*s in 
the* diagnosis iind rc*nn*cliation of rc*iKlinK |)roblenis and by tho 
rc'|)orts ol dc*ficit thc*orists who argui* that tht* t*nvironnn*nr ot 
"the* lower c lass" inhibits tin* di*vc*lo()nK*nt of auditory discrimina- 
tion, thi*rc*bv cri*atinK in "lower class" children deficiencii*s in 
auditory discrimination ibility. Of (^articular intt*r(»st was the early 
rc*searc h of ClynthitJ Dc*utsch ( l%7ti) which ap|)tirc*ntly sc*t the* stage 
tor siibse*(|ui*nt studies reflating auditory discrimination ability to 
sen itil ( Kiss and race*. 

De*utsch re*|)orte*cl that thc*rc* was a significant correlation be- 
tixven ri\}f)ii\ii ability dnci r}Hditory discn me nation rn b/ack "lower 
cltiss" m«ile*s. ( rhe*sc* fiinlings su|)|)orte*d \Vc*|)nian's data,) Dc*utsch 
( l%7a, |)|). 2h8-h^)) also rc*|)()rtc*d tJ significant rc*lati()nship betwc*en 
vc*rhal |)cMformanc c* and |K*rfc)rman( c* on the WADT, 

Deutsch tilluclc*d to iininnil studies which indicatc^d that auditory- 
c*vc)kc*d |)()tc*ntitil i rc*(lucc*d wh(*n the aninnil is attc*ntiv(* to stimuli 
in otln*r nn)clalitic*s. These findings, according to t3caitsch, are 
consistent with findings tlnit signal-to-noisc* ratio inflLic*nces the* 
stimulus |)e*re (*iv(*d tirnl the* res|)()nse* e*V()ke*d. Sin* corn ludud that 
'iU ( urate |)e*rc e*|)tion re*sults from tJ highe*r sigrnil-to rn)ise* riitio 
l)e*utsch hy|)othe*si/enl thiit with ti low ratio, or a lot of rn)ise* in the* 
svste*ni, (*\ce*ssive* activation of the* re*ticultir system inte^rfores ^vith 
dn* trave'l of the* signal U|) ne*ural paths. She* turthe*r hypothesized 
that e*\( e*ssive* tictivation he*y()n(l the* o|)timal le*ve*l nec e*ssary to 
|)re'|jiare' the* organism to iicce*|)t lUnl resiionci to a stimulus |)r()- 
(luce*(l a bloc king out (i\ the* stinnilus. Since* auditory stimuli are* 
e*ve*r |irese*nt. Dt»utsc h |)ostuitite*d that aLiditory stimuli are partic- 
ukirlv |)r()ne* to a ".uning-out" |)r()ce*ss or le*arne*d inatte*ntion, 
DiHitsc h ( |). bH) re*|)orte*d th.it the* "tuning-oiit" |)ro( \*ss did 
not take place* tit the* le*ve*l of the* reticular system; rather the 
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stimuli r(\u Ins ilu» u»iilr<il piojiu lion mw hut is not dtttMKlrd to. 
She contended that one could c»\|hh t that a child raiscnl in a vc^ry 
noisv iMivironnv.Mit witli littio diroc ted and sustained S|HV( h stim- 
ulation would bv delic iiMit in his or her discrimination and recog- 
nition of spe(»ch sounds. One could liirtllei e\'|HH t. accordinj; to 
Dcaitsc h. that tlie child raiscnl in a noisy cMivironincMit would l)e 
relatively inattentive* to auditory stimuli and hav^e difficulty with 
oth(»r skills that (le|)(MKl u|)on v.nni auditory discrimin uion. She 
suggests that the slum child liv in a vc»ry noisy environment and 
gc»ts little connected or concentrated speech direc ted to him or 
her. Deutsch (1%7a, |)|). JbJ-?") concludinl that if her hypotheses 
are accepted and viewinl in light of her riM'arcli findings (signif- 
icant correlations hi»twet»n vi»rhal al)ility and auditory discrimina- 
tion and reading ability and auditory (li.>c rimination), it could well 
be that "l(nvi»r class" youngsters, S|)ecifically "lower class" black 
youngsters, who live in noisy environments do not develop the 
rcujuisite auditory discrimination ability to learn to read \\v\\. 
Middle class chil(ir(»n from quieter and more speech-directed 
environments do not have this problem. 

Deutsch's arguments are refjorted here in detail because it would 
ap|)ear that they cMigendered the* idea that auditory discrimination 
deficiencies might bc> characteristic of certain ethnic groups and 
socioeconomic levt»ls. Ht*r hy|)otht»ses wc*re widely ac( (>pted, oft- 
quoted, and served as a basis for much of the subsequent researc h 
on auditory discrimination. Clark and Richards (1%b, p. 262) 
re|)()rted that thcMr researc h rc»veak*cl » ''e-schcM)! economically dis- 
advantaged chilclr(»n exhibit(»d significiuii deficiencies in auditory 
discrimination. Berlin and Dill (1%7, p. ;}86) tested the effects of 
fe(*dback and reinforcemcMit on "lower class" black children's 
performance on the WADT. Oakland (1%9, p. 37) found that a 
signific ant relationshif) between auditory discrimination and reacH- 
ing c»xisted when reading achievem(»nt scores of "lower class' 
childrcMi were ciorrelated with the* results of a phonemic test of 
auditory discrimination {W\DT). but the relationship did not exist 
when reading achiev(»m(»nt was correlated with the results of a 
non-phoncMiiic assessment of auditory discrimination, 

(deficit theorists reportc^l a significant difference between the 
auditory disc rimination ability of "lowc»r" and "middle class" chil- 
clrc»n. The results of thiMr studif^s rc^vealecl that poor readc^rs within 
social class groups experii?nciHl significantly more difficulty in 
auditory discrimination than good rc»aders and that the difference,* 
between good and fioor readers was grt»ater for the "lower class" 
group. In support of Cynthia Deutsch's t(»ntative hypotheses. 
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N^iirtin Driilsc h (l^)<)7ii. (), 4H) suKH(»sto(l thv ()()ssihilitv thai the 
(lilti( ulties luicounti^riul by "lovvor cLiss" chilclrc»n could l)o attrib- 
uted t(» noisy homes, lack ot [practice in auditory discrimination, 
and limited verl)»il interaction ln»tvveen children and adults. 

H(>reitiM acid lnm»lm<inn {\^)hU, ()p. W-Vy) compared "lower 
class" black children ^to dtMl c hildriMi <ui(l implied thatduditory 
(Kohlems Ciiused them to triMt strings of single words as though 
thi>v were onv word. Th(»y Ctilled this "th(» t»iant-word syndromiv" 
Although Oakland ( lObM) sought to add to the support tor a 
corriHation l'>etween rcMclinti achievement and auditory discrimina- 
tion amonf^ "disadv»intaKed" youngsters, he recognized the pos- 
sibility that al)ility to (lertorm well on a test of auditory 
discrimination mi^ht be aftec ted by the dialec:t of the examiner. 
Linguists contend that thi> dialect ot the youngster mit^ht also 
affect performance on a ()honemic test of auciitory discrimination, 
.j.tibov (I^)b9l), p, ^^7) oPservi>fl in his studies of the language of 
liliK k youth uan^s tliat black yount^sters experienced difficulty 
perceiving phonemic contrasts which were not in their own dialect. 
Harat/ (1%9b, p. 47) has indicated that whereas the test most 
wi(l(dy used to measure auditory discrimination (the WADT) 
e(i;iates corri>ct responses with judgments of equivalences and 
tliff(>r(>n( i>s in "standard" English sound usa^e, black children 
respond on thi> l)asis of th(> sound usa^e learned in their social 
and ^eot4ra()hical milieu. According to lohnson (1971, p. 151), 
phonological conflict points exist between the ''standard" sound 
usaye and the sound usatie of black youngsters, lohnson con- 
cluded that liecause these youngsters are accustomed to a dif- 
ferent sound system, they are therefore equipped with different 
auditory skills. 

Thc» art^uments advanced liy Lubov, Barat/, and johnson are 
supported by the research of Gross (19b7, p. 2124), who inves- 
tigated the relationship between reading comprehension and di- 
ale( t divetyt^nce cuid between pronunciation and auditory 
discrimination. Gross first investigated the sounds omitted or 
"distorted" by his sample of 72 black youngsters. His findings 
revealed that the sounds most frequently omitted or changed were 
also th(» sounds most frequently missed in auditory discrimination. 
Gross's investigation furthc>r reveak^d that the subjects i^xpi^rienc (kI 
more difficulty discriminating word pairs comprised of words 
which hc»d an alternate dialect pronunciation (example: wind/win'). 

Stev(»ns (1972, p. bb) has suggested that tools for collecting 
information cjbout various ethnic and cultural grou()s are not 
^jnctionally equivalent across groups. If research data are to be 
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meaningtui, i{iV(»siiHtil(»rv pioi tuluri^s must conirol tor critical 
ditterences between various groups. The deficit theorists relied 
almost exclusively on the WAOT to measure auditory discrimina- 
tion ability. The validity of the deficit theory is contingent upon 
the appropriateness of the WADT as an instrument for measuring 
the auditory discrimination ability ot youngsters whose dialects 
differ from the dialect upon which the test is based, Validitv also 
depends upon the research procedures used to control for the 
dialect differences. Speakers of the "nonstandard" dialects might 
perform poorlv on the WADT because several items reflect phono- 
logical conflict points (Politzer 1971, p. 177). This investigation 
was undertaken to study several of these items and to determine 
their effect on performance. 

Procedure 

St/h/ects. The subjects for this study consisted of 48 black young- 
sters who were nt»aring the end of fifth grade. To assure variance 
in the speech patterns represented in the sample, subjects were 
drawn trom two very diverse populations. Prerequisites for partic- 
ipation included evidence of the absence of hearing defects and 
ability to read and comprehend the passage used to assess speech 
patterns. Only average and above aveiage readers were chosen. 
The sample consisted of 22 bovs and 2b girls ranging in age from 
10 to 12 years. 

Motisuring Instrumvnts, Two informal instruments were construc- 
ted to identify speech patterns. A reading passij;^ was developed 
which was loaded with words that lent themselves to e/'h f/th and 
v/the neutralizations which, according to the literature, are char- 
acteristic of the speech of the "lower class." These neutralizations 
are reflected in items on the WADT-^pvn/pin (item 40), shear/ 
sheath (it^m 28) and c/of/ie/c/ove (item 2S) (Wepman 1958). The 
passage was followed by seven comprehension questions which 
were read to the subject by the examiner. The ten responses 
elicited required the subject to repeat selected words. The second 
instrument used a sound-matching task to further assess the pres- 
ence of neutralizations. The instruments which evaluated speech 
patterns consisted of 65 items or words which reflected the afore- 
mentioned neutralizations. 

To estal)lish the reliability of the informal measures of speech 
patterns, these 65 items were compared to a Rasch Model to 
determine those which best measured speech patterns. The Rasch 
Model is a special form of the logistic response latent traits model 
and is used to select those items in a test winch are good for 
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nu'iiMiiitiK «i s|)(M iti( trail (Wright PUi7). I his tifuilysis indk titod 
th(* T) itiMiis uhi( h lu'sl fiUMMiriHl spiHH h piitUMiis, lliosi* items 
slunvinl a r(»l.'al)ilitv ot +.81 i\=4H). A s|hhh h piillorn sioro was 
lal)ulat(Hl has^nl ofi th(» I?) iuwns tinci this scoiv was usikI in sub- 

Form I ot tlu» U/\/)f (WVpman was us(hI to nuMSuro 

(l(»vt»l()|)nuMit ir iiiulitorv disi rimiiiation. 

Results IVarson |)rocliK't-mofn(Mil corri'latioiis wva^ tomputed 
h(*tW(H'n \V'\ni (MTors and (»rrors on items 25, and 40 of tho 
IV.\/)T llu^se items ( ()rres|)()iid with v/f/uv t/th, and v/i ntni- 
trah/atiofis iind th(» speec h |)tittern scon* i^revioiislv discussed. The 
r(*sults inchi iited no si^nitic ant relationship between v/i neutrah- 
/iitions and item 40 of tUr lV/\/)r Sinie all of the subjects neu- 
trtili/(Hl /;e/] pin, failurt» to estal)lish a positive* correlation here 
is (loul)tless (lu(» to the kick of variance iimoriK the subjects with 
rt^spiH t to this (particular neiilrali/ation pattern. Subsequent anal- 
vs(*s did not include examination of the relationship between item 
40 and e / ni^ulriiii/iitions. 

Su|)|)ortinH the hy|)othesis that youngsters would experience 
diftK iilty discriminating items which reflect phonological conflict 
points, the (orri^lation between VV/\/JT errors and errors on items 
reflecting conflict points (dothv/dow and shvdf/shvath) was sig- 
nific ant at the /)<.()l level. 

In ordiM" to ascertain whether the WADT score a-nd performance 
on items 21 and 2i\ fc/(U/ie/c/ove and shiwf/sluwth) measured 
speech patti>rns iis vveli as auditory discrimination, a multivari ite 
analysis of Viirianct* was done, ihv speech pattern scores were 
divided into low, average, and high groups. Of interest here was 
whether th(> VVADT scones of the three groups wore significantly 
different. The differences among the threi* groups' performance 
on the WADT and on items 2^5 and 2H (dothv/dnviy and sheaf/ 
^lu\ith} was signific lint at the p<.01 lev(»L supporting the hypoth- 
esis that speech patterns are pri>(lictive of performance on 
the WADf 

A subsequent analysis t>f co-variance was done t(; determine the 
influence that (x^rfornicinct? on it(>ms 21 and 28 had on the total 
WADT score. The results of the univariate analysis of co-variance 
indicatiHl that it(Miis 2.1. and 28 W(»re significantly related to total 
WADT score (p<.()l); however, th(^r(> was no significant difference 
{/;<.2}) betW(»eri [hv performanci* or the low, average, and high 
s\)vvi \} patt(»rn gr()Uf)s vvln»n those itmns v/ere removed from the 
t(?st 
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Discussion 



Deficit theorists used comparative analyses ot the test scores 
qnd lanKua^t^ behavior o\ "lower" and "middle class" youngsters 
to'conclude that "Iowim* clas*i" hiack children were linguistically 
and auditorily deficient. Linguists, in the main, dealt with descrip- 
tions of syntactic and phonological systems and avoided hierar- 
chical judgments about the effectiveness of one system over 
another. They concluded that while the syntactic and phonological 
. systems of "lower class" black youngsters may differ in some 
respects from "standard" English, these differences do not con- 
stitute deficiencies. 

There is little empirical evidence to support either position on 
auditory discrimination deficits versus differences. Evidence used 
in defense of the deficit theory appears to be based on an auditory 
discrimination task which apparently measures more than ability 
to v^iscriminatt? pairs of phonemes. 

Cvnthia Deutsch (1%7a) postulated the existence of iJiiditory 
discrimination deficiencies resulting from an environment which 
inhibits development of auditory discrimination. Deutsch's hy- 
potheses are based on a significant correlation between reading 
achievement scores and performance on the WADT, There was no 
data presented correlating the actual living conditions of the sub- 
jects with performance on the WADT in the statistical analyses 
offered to support the hypotheses. 

The present study documents the difficulties that can result 
from WADT items which reflect conflict points between the dialect 
of the subject and the dialect of the test. This data supports the 
findings of linguists, as well as the observations of deficit theorists 
who admit that "lower class" youngsters perform as well as "middle 
class" youngsters in discriminating initial phonemes (although 
^ their ability to distinguish final phonemes is significantly different). 

The task of judging the sameness or difference of word pairs is 
complex. It involves hearing, perceiving, memorizing, and decision 
making (Blank 1%8, p. 1100; Politzer 1971). Assuming that all 
children have an equal chance of overcoming most of the complex- 
ities inherent in this kind of test, one factor continues to separate 
"middle class" youngsters, who very likely speak the dialect of the 
test, from those who do not, specifically black, Spanish-speaking, 
and Appalachian white youngsters. That separating factor is the 
difference between the phonological systems of these children and 
the system upon which the test, the WADT in this case, is based, 

The factors which influence performance on the WADT must be 
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controlled it it is to he validly used in research. Deficit theorists did 
not control for dialect differences; ther.*fore, deficit hypotheses 
are invalidated by their dependence on the WADT. 

It is important to note that Wepman (1960 and 1%8) defined the 
appropriate use of the WADl. It is apparent from hi^ definition 
that the test was constructed to measure individual development 
in order to more effectively meet individual needs. When u^^'d as 
prescribed, where responses can be evaluated in terms of ,m''!u- 
encing factors, the WADJ is a good diagnostic tool. The us- of 
WADT scores to generalize group deficiencies and to justify g »>*jp 
training to cure group ills is a misapplication of the test. Wepman 
warned that group auditory training is ineffectual. 

Effective educational programs can evolve only from precise 
research data. Historically, programs resulting from inaccurate 
descriptions have consumed considerable time and money but 
failed to extensively improve the lot of the "underprivileged" 
child. Labov (1969a, p. 72) contends that the interventionalists, 
in their evaluation of the data, will not fault the theory or the 
method but will fault the child. Those who framed the Headstart 
Programs were suggesting that at age four it was already too late 
to reverse the effects of cumulative deficit; therefore, "deprived" 
youngsters must be reached even sooner. 

Cynthia Deutsch (1967b), despite Wepman's warnings, at- 
tempted group auditory training with a group of third grade 
reading' retardates who were deficient in the "skill" of auditory 
discrimination. After a semester of training, there was no dif- 
ferential auditory discrimination improvement between those 
who received specific training and those who did not. 

Because the deficit theorists assumed that performance on the 
WADJ was functionally equivalent across ethnic groups, they 
failed to control for differences between the phonological systems 
of their subjects and that upon which the WADJ was structured. 
Their failure to use controls appears to invalidate their findings. 
Future research should establish different stimulus situations for 
different ethnic groups so that comparable behavior can be ob- 
served. Reports based on the supposition of a white middle class 
norm are meaningless for the optimal development of youngsters 
. who do not fit this category. 
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Use of Informal Reading Inventories 



TeachiriR, tis well as clinicdl work in readinj}, involves insightful 
observation and analysis ot the child's performance in order to 
plan, implement, and evaluate effective learning situations. The 
informal reading inventory may be the most useful observation 
technique available for assessing reading performance in order to 
plan effective instruction for readers who have not done well in 
conventional situations (Farr 1969, p. 98), For those unfamiliar 
with the informal reading inventory, johnson and Kress (1965) 
provide a concise, practical introduction. Some ideas from re- 
search warrant application when informal reading inventories are 
used; in this review, we will describe selected insights and knowl- 
edge from research and draw implications for using informal 
reading inventories. 

Teachers who are able to observe, analyze, and interpret oral 
reading responses possess one of the most useful skills for assessing 
children's reading. From understanding gained about students' 
reading processes, a teacher can plan appropriate instruction and 
evaluate its effectiveness. In recent years, the considerable re- 
search using oral reading analysis as a basic tool has furnished new 
insights. Suggestions for improving informal reading analysis fall 
into four areas: ( I) using and selecting passages, (2) recording oral 
reading responses, (J) interpreting oral reading responses, and 
(4) evaluating comprehension. 

Using and Selecting Passages 

Soiircvs of Crtulvd PiUdHhiphs, It is common knowledge that a 
number of commercially prepared publications provide a variety 
of graded paragraphs bound for long-term use (Harris 1970, pp.. 
l.iH-47). IJy drawing upon several published inventories, teachers 
can provide themselves with several sets of graded paragraphs. 
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I\U^IisIhhI invrnl()(ii»s iniiy iilso provicit* norms or avuruKe expected 
scores at spec ific ^riule l(»vels. 

Teacher constructed inventories compose(j ot selections from 
basal readers or workbooks have tlie adcled advantage ot enabling 
the teacher to identity appropriate instructional materials in addi- 
tion to determining what reading strati'gies the child uses, A 
number ot researchers h ive (lescril)tHl the use ot graded textbooks 
tor assessing; reading pertormanct* l)y having children try to read 
various l)()()ks. VV()rkl)ook piissages may be preferable to basal 
passiiges when they include prepared questions for evaluating 
comprehension. Passages can be graded with the level assigned to 
books or workbooks by the publishers, through traditional readabil- 
ity methods, or more quickly and reliably through cloze readability 
procedures described by lioimuth (1974). 

A clinician or teacher who is trained in statistics, or has statis- 
tical consultant help, can generate norms or average score expecta- 
tions tor passages specifically for the children who make up the 
instructional population. The point is that concerned teachers or 
clinicians need not be bound to less productive procedures be- 
cause of a lack of graded paragraphs. 

Usin^ CriUlvd i\}n^firc^:>hs. Graded paragraphs from standardized 
individual reading inventories can be readily used in at least three 
ways. One use involves a listening test where the clinician reads a 
passage to the subject and asks comprehension questions; this 
yields a listening comprehension score which can index how well 
a child may be able to learn to read. 

A second use of graded paragraphs involves an oral reading 
test. This test yields (1) an oral reading word recognition score, 
(2) miscues-' unanticipated oral responses (K, Goodman 1965) — 
that can be analyzed to reveal how the reader uses contextual and 
word recognition strategies in comprehending print, (3) an oral 
reading comprehension score, and (4) a reading rate score. The 
third use involves a silent paragraph reading test, which yields a 
reading rate score and a silent reading comprehension score. All 
of these tests provide a clinician or teacher opportunity to observe 
the child while reading. To fully use the test tactics — listening 
comprehension, oral reading, and silent reading—three sets of 
grcuitn] paragraphs are required. Presently, few commercial in- 
ventories supply more than two sets of graded paragraphs. Clini- 
cians net?d not abandon their favorite inventory, but should simply 
augment it with additional sets of graded paragraphs. 
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Lunfivr Piissa^vs MiMiosky (1')71) demonstrated that readers proc- 
ess ditterently at the Ijeginniny of a passage than they do at the 
middle or end. Changes occurred with her sample around the 
250- or iOO-word mark. It was not clear whether the changes were 
due to fatigue, learning resulting from processing, or other factors. 
It is clear that we can learn much about a reader's processing in 
oral reading by using passages that substantially exceed 300 words. 
It is also important to note the correspondence between normal 
reading demands in school and test passage length. Frequently, in 
normal classroom activities, students are required to read passages 
that exceed the length of graded paragraphs used in most commer- 
cially prepared inventories. The widespread practice of using 
paragraphs of about 200 words or less in informal reading in- 
ventories need not be abandoned; instead, we can augment 
present inventories with a longer passage. 

To obtain a sufficient number of responses for analysis, the 
longer passage must be reasonably difficult. Performance 
on shorter paragraphs can provide the information needed to 
select a longer passage that is appropriate. The longer passage 
should be about one level more difficult than the instructional 
level established by conventional informal reading inventory pro- 
cedures (see Johnson and Kress 1965 for conventional procedures). 
By selecting a set of longer passages— 500 to 600 words— that 
correspond to the levels in the informal inventory, a relatively 
efficient technique can be added to present informal reading 
inventories. y 

Recording Oral Reading Responses 

Observing Oral Reading. Experiences of miscue researchers caused 
reexamination of the observer's role in both reading research and 
clinical work. Three language processing interactions are sources 
of variation in observing oral reading (Page 1973, p. 68). One inter- 
action involves the reader processing the print. The two other 
language processing interactions involve the clinician or teacher, 
who (a) also processes the print and produces an internal reaction 
to it that functions as an expected response and (b) processes the 
readers oral responses and produces an internal reaction that 
functions as the observed response. The three interactions— the 
reader to print, the clinician to print, qnd the clinician to the 
reader's responses — are interdependent. Each interaction involves 
the use of language and each is a source of variation in observing 
oral reading performance. 
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DidliH t f*rt's(»rU prcUt'ct' HtMierally ijinores tht» two inU^ractions 
involving tUv t linit lan or ttMcher. ThouHh rrsearclH>rs have not 
yet taken up the t hallenye that these interactions pose, teachers 
and reading clinicians can apply the insights in several ways. When 
a clinician's dialect is distinctly ditterent from a reader's dialect, 
it is reasonal)le tor the clinician or teac her to ( aretully examine 
expectations and the reader's pertormance. The reader's responses 
may be acceptable in his or her dialect even it they deviate from 
the clinician's dialect. Experiimced clinicians have lonj4 recognized 
this problem and many have intuitively adjusted their assessment 
techniques. Evidence suyyests that dialect divergence probably 
does not interfere with comprehension (Goodman and Buck 1973; 
Sims 1972). When weiyhiny oral reading error scores against com- 
prehension scores ior a dialect divergent reader, the comprehen- 
sion score should take precedence, since differences in dialect 
between the clinician and the reader nniy have inflated the oral 
reading errors. 

Tape KiHurdififi. Another implic-ition of the three interactions 
involves memory. Both of the clinician's internal responses, the 
response to the print and the response to the reader's oral response, 
must be held in memory while the clinician compares them. The 
widespread practice of marking a typed script of the passage while 
the reader responds should be continued, but an additional in- 
expensive technique, already commonly used, can reduce the 
heavy reliance on the clinician's memory. By tape recording the 
reader's oral responses, the clinician can analyze the responses 
as many times as necessary. The cimician can also get help from 
others in analyzing the responses, a procedure that researchers use 
regularly to establish observer reliability. This is particularly help- 
ful when the dialects of the clinician and reader diverge extremely. 
Miscue research has capitalized on tape recording and demon- 
strated that it yields substantially more information than can be 
gained by listening once as the reader reads (K. Goodman and 
Burke 1973). . 

Interpreting Oral Reading Responses 

LwfiUdfiv Knowlvdfiv. A third implication of the oral reading ob- 
S(»rvation f)r()cess described above involves recognizing the part 
that language plays when anyone analyzes oral reading perform- 
ance. A speaker of English can do far more than simply identify 
and count oral reading errors, since the observer can use his or her 
language to assess the type and quality of the response. Miscue 
research provides an empirical framework and the Rvading M/icue 
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Inwntory (Y. GikkImmm .ukI Uurko 147,0 provicl'^s im or^i^nizd- 
tional structure tor tU)plvinH tln» insights in clinical work. The 
lanKua^e of the author, the reader, and the clinician or teacher a^e 
inseparably involved. Thouyh linguistics is purely descriptive and 
cannot tell us how lanyuaHe should be, the descriptions of how 
lanKuaKe works that linguists provide can improve our under- 
standing of what happens in the reading process. 

K. Goodman (1%5) studied oral reading; errors a:, niiscues or 
deviations from the text rather than as mistakes indicating poor 
reading. He constructed a model that depicted reading as a sam- 
pling process in which all the available information is not used, 
but only selected cues are processed to form guesses (1970, 
pp. 30-;}1). Goodman ( l%7) described reading as an inquiry proc- 
ess in which the reader seeks to verify or reject his or her guesses 
on the basis of information and inferences drawn from thrt»e cue 
systems: the semantic, syntactic, and graphophonic. The semantic 
cue system draws on both word meaning and contextual meaning. 
The syntactic cut* system involves grammnticdl structures and the 
arrangement of words, phrases and clauses, etc. The graphophonic 
cue system rt^ates the sounds and graphic forms of printed Ian- 
:4uage (Allen 1972). 

Suhstitution and MisfnonuncitHivn Miscues. Insights can be gained 
by analv -^mg miscues that are substitutions or mispronunciations. 
It is useful to separate substitution responses into two groups: 
(1) frequently used content and function woids found in basic 
lists, .inci (?) unusual words. Two questions help us analyze the 
substitutions or mispronunciations produced in response to fre- 
quently used words. First, what proportion of the total number of 
sight words in the passage generated miscues? Second, do these 
miscues distort the author's meaning? If very few of the total 
substitution and pronun^. iation miscues are responses to frequently 
used words, and those miscues do not distort the author's meaning, 
then they are probably no cause for concern. However, if the 
portion of substitutions or mispronunciations with frequently used 
sight words is high, or if the miscues distort the author's meaning, 
further diagnostic work and teaching of sight words may be in- 
dicated. Isolated sight word recognition should not be construed as 
a test of the full reading process; rather it indicates development in 
one aspect of reading. Similarly, instruction in sight word develop- 
ment should not be limited to isolated words. Experience stories and 
activities using words in a variety of contexts provide the most 
direct and logically defensible route to reading with understanding. 
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How ii cfiild ulrntitirs words can be inferred by analyzing the 
child's substitutions and mispronunciations in response to unusual 
content words. The method used to teach the child to read will 
influence how he or she attacks unknown words (Elder 1971; 
DeLawter 1970). Typically, a child who has been taught reading 
with primary emphasis on comprehension and the development of 
a sight vocabulary produces meaningful substitutions and few 
mispronunciations that are nonwords. The substitution miscues 
tend to approxmiate the printed word in length; initial conso- 
nant(s) and sometimes final consonant(s) usually agree with the 
text. The maiority of substitutions are semantically appropriate, 
at least within the immediate sentence context. There may be a 
tendency to correct semantically inappropriate words. 

In contrast, the oral reading responses of a child taught with 
emphasis on phonic decoding tend to display the following miscue 
characteristics: a high proportion of mispronunciations or non- 
words, a high degree of graphophonic similarity between the 
printed word and the oral response, a tendency for a high propor- 
tion of the miscues not to be semantically appropriate, and correc- 
tion made mainly on the basis of graphic rather than contextual 
cues. The nature of a child's functional reading strategies has 
implications for instruction. If a child's listening comprehension 
exceeds reading compreheiision by a grade or more, his or her 
present reading strategies can probably be improved through 
instruction. 

The Correction Process, The number and type of miscues that 
prompt the reader to make corrections illuminate how he or she is 
processing the print. Some miscues elicit no correction attempts 
because the reader is satisfied. Some defy correction because the 
reader has no means for recognizing the particular miscUe within 
his or her system of processing print; this may reflect instructional 
practice. Still other miscues appear to go uncorrected because the 
reader chooses not to reveal recognition of the mistake. 

A reader who corrects a response is evidencing dissatisfaction 
with the original oral response. These decisions to correct can be 
sorted into several categories. Consider an oral reading miscue 
that is semantically and syntactically acceptable but differs grapho- 
phonically from the expected response, as in "Tim ran down the 
road " for "Tim ran down the lane/' If the reader-does not attempt 
to correct the miscUe, it is reasonable to assume that the semantic 
and syntactic cue systems permitted him or her to verify the guess 
and feel satisfied with the orif.;mal response. We can also assume 
that, to some degree, the graphophonic discrepancy did not cause 
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(lissatist^.ction. It no p.iusps or otlu^r niisc ues immediately precede 
or follow this response, lUv assumption about a weak Rrapho- 
phonic system is reinforced. If the reader uses road and lane 
interchangeably in a semantically acceptable way throughout the 
passage, this assumption is strengthened further still. 

If. on the other hand, the reader attempts to corrcnit the response 
of road for /ane, we may assume the graphophonic cue systems 
are operating because the origmal response caused dissatisfaction. 
An attempt to correct may be successful or unsuccessful. If suc- 
cessful, and no further correction attempts occur, we may assume 
the graphophonic cue system to be operating well. If the successful 
correction is abandoned through a subsequent unsuccessful at- 
tempt, we have less support for assuming the graphophonic cue 
system is operating. 

A semantically :\r\ii syntactically unacceptable response, such 
a^ "Tim ran dovi^ the /one/' warrants interpretation in a similar 
vein. No correction attempt suggests that the semantic, syntactic, 
and graphophonic cue sy:items are all weak to some degree. If the 
reader attempts to correct and struggles with a vowel change such 
as /ean for Lino, we can assume the graphophonic system is 
generating the correction attempt. On the other hand, a correction 
attempt of line »or lane suggests all cue systems may be involved. 

When a reader abandons an originally correct response, as some 
do, 3nd attempts one or several corrections, we can theorize about 
the cue systems that are operating. Clay (1967 and 1968) found 
low error but high -..elf-correction with high-ability 5-year-olds, 
while low-ability subjects produced a high incidence of errors and 
low self-correction. K. Goodman and Burke (1973, p. 90), with a 
sample ranging from 2nd to 10th grade^ found low-ability readers 
corrected graphically uncompliant miscues more consistently than 
did average- and high-ability readers, who also tended not to 
collect phonemically and graphemically highly compliant mis- 
cues. Clearly, a careful look at which iniscues elicit a correction 
and which can go uncorrected can yield a great deal of information 
about the reading process, information that present practices tend 
to ignore. 

Evaluating Comprehension 

Difficulties with measuring reading comprehension are not lim- 
ited to informal reading inventories. Problems center about in- 
consistencies in attempts to measure assumed subskills of reading 
comprehension (Farr 1969, p. 56) and inadequate attempts to 
define comprehension entirely in terms of visible activities. As 
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Simons s.iys, ". . tin* c oniprc^liiMisioii proct^ss is iiidccessililo to 
direct obsorvtition . . . ( 1^)71, p. .140). " In view of these ditficulties, 
one should n(^t use results from a s\n^\v test of comprehension 
without c ()rr()lM)rative infornuUion. "A tc»st should be vit>wed i\s 
only one piece of inform. ition for making decisions (Fdrr and 
R(^ser 197^, p. Additioiitd intormation on comprehension 

performance c an extend the web of interrel.ited information on a 
child's reading performance and thus provide a better base for 
c>(lucati()niil prescription; descri]).tipns follow of three tactics that 
can bc» used to augment conventional comprehension tests. 

Rvti^Uin^t Cotupn'hvnsion. .\. Goodman and Burke (1972) have 
expknned how teachers can assess comprehension by having the 
sul)iect retell the story and respcMul to a series of open-ended 
questions. The* procedures can l)e applied to passages 300 words 
and longer. Analysis of the retelling generates a comprehension 
rating. K. Goodman and Burke (1973) providc^d empirical backing 
for the r(>lationship of the retelling rating to oral reading miscues. 

Thv Cumprvhvndinn Score. A single passage ot 500 to 600 words 
permits assessing comprehension with a "comprehending score," 
using procedures outlined by Rousch (1972) and K. Goodman and 
Burke (1973). A comprehending score was defined as: the percent 
of oral reading miscues that are semantically acceptable added to 
the percent of miscues that are semantically unacceptable but 
successfully corrected. The comprehending score correlated highly 
with the retelling cojiiprehension rating in the study by K. Good- 
man and Burke (1973, p. 68). No criterion norms are yet available 
for the comprehending score. 

Comprehending scores are simple and inexpensive to calculate. 
As is t\v^ case with most scores, they do not yield dependable 
information ak:)ne, but used in conjunction with other scores, 
they help fill in a picture of the reader's processing. Since the 
comprehending score is generated entirely from oral reading per- 
formance and the retelling comprehension rating is generated 
from the child's responses following oral reading, the two scores 
corroborate each other. In addition, a comprehending score can be 
computed on the first half of a 500- to bOO-word passage and 
compared with the comprehending score on the second half tci 
reveal changes in proct?ssing after 250 words (Menosky 1971). 

T/ie Clo/v Tesf. A clo/e test with every fifth word deleted and 
v\i\c{ answers scored correct has high concurrent validity with 
multiple choice tests of literal comprehension (Bormuth 1969, 
p. 365). This validity and the fact that it is reliable, inexpensive, 
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and tMsily administcMrd niak(» tin* clozo t(>st a wry loasonablt* 
technique to in('()r|)()rate in tin* intormal reading inventory. The 
cloze test needs 50 or more items; thi»refore, passages ot 250 
words or more are required. Bormuth (1972 and in this volume) 
|)rovidi»s crit(»ria tor interpreting v\o/v t(»st performance. The cloze 
test warrants a gr(»at deal ot further study because it is convenient 
and reliahit* arul it provides another tool to help determine what 
is actually me.^sured by convi^ntional comprehension tests. Clearly, 
we need to cievelop new tools to build more ade(|uate explanations 
ot comprehension than presently exist. 

Conclusion 

The kKms in this paper begin to show us the improvements in 
informal reading inventories that we can make with insights from 
recent r'\search. Researchers have much to do in the areas of 
validity and measurement. The comprehending score warrants 
further study. The interpretation of miscues and their corrections 
|)roniises better ways of assessing performance. Publishers may be 
expected to provide more graded paragraphs, both short and long. 
More precise indices oi conventional cloze performance can be 
expected. The concerned reading teacher, reading clinicitin, and 
administrator have much to gain by following the breakthroughs 
that regularly occur in current research, with the ultimate goal of 
better helping youngsters learn to read. 
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